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yAt)  Closed  loop  system  command  input. 

Y Describing  function  mode..l  for  pilot  dynamics; 

Y (ioj  ) = ... 
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1.1  ST  OF  SYMBOLS  (CONT 1 NUK D) 


V.J,  Response  ol  threshold  in  visual  position  sensor. 

7.^  Dimensional  z-force  derivative  with  respect  to  w;  1/sec. 


^_ee k_  Symbo  1 s 

Low  frequency  phase  approximation  parameter  in  the  "I'recision 
Filot  -Model". 

Gust-induced  angle  of  attack;  degs. 

Signal  from  the  central  processor  ol  pilot  model  to  the 
neuromuscual  r .system. 


Signal  from  the  q-channel  of  the  pilot  model  central  proc- 
essor to  the  neurorau.scul ar  system. 

Signal  from  the  x-channel  of  the  pilot  model  central  proc- 
essor to  the  neuromuscular  svstem. 


Signal  from  the  y-c.hannel  of  the  pilot  model  central  proc- 
essor to  the  neuromuscular  system. 


Signal  from  the  u-channel  of  the  pilot  model  central  proc- 
essor to  the  neuromuscualr  system. 

Time  step  size  in  the  computer  simulation  of  pilot-vehicle 
system  dynamics;  secs. 

Pilot's  control  response;  degrees,  radians,  or  inches. 
Elevator  deflection  angle;  degs  or  rad. 

Damping  ratio  of  second-order  component  of  the  neuromuscu 1 ar 
system  describing  function. 

Damping  ratio  of  tlie  short-period  mode. 

Pitch  attitude;  deg.s  (unless  otherwise  specified). 

Real  part  of  complex  variable  s. 

RMS  value  of  comm' nd  or  disturbance  Input  to  t fic  pilot- 
veliicle  system;  inches  of  displayed  error  or  t/s. 
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l.isr  OF  SYMBOLS  (CONTINUED) 


qua  lily 
otliurwisu 


qua  lily 

metric  for  any  tracking  task;  indies  (unli'ss  otlierwise 
specif ied) . 

CL.  RMS  value  of  any  signal  x.(t). 

i 1 

X Time  delay  in  the  sensation  of  visual  rate,  or  time  delay  in 

tile  "Precision  Pilot  Model";  secs. 

Equivalent  time  delay  in  the  human  pilot  describing  1 unci  ion 
for  the  special  case  x,  (t)  = 0;  secs. 

"cj  Equivalent  time  delay  in  tVie  human  pilot  describing  function 

originating  due  to  dynamic  coupling  between  the  nonlinear 
delay  and  tlie  neuromuscular  system  dynamics  as  a result  of 
closed  loop  control  of  rate  error  for  the  special  case 
Xj  ( t ) = 0 ; secs . 

"'-nn  Neuromuscular  sysr.em  time  delay  for  the  "Precision  Pilot  Model 
secs . 

X-  Average  value  of  the  nonlinear  delay  x(x  );  .secs. 

(<*))  Power  spectral  density  of  the  time  signal  x,(t). 

X.  I 

# ^,fjtu)Cross  spectral  density  of  the  time  signals  x.(t)  and  x,(t). 

■*i  M ^ J 

4>  Aircraft  roll  angle  or  the  transfer  function  phase  angle; 

degs. 

Aircraft  heading  angle;  degs. 

CO  Imaginary  part  of  tlie  complex  variable  s;  rad/sec. 

Bandwidth  of  command  or  disturbance  input  lu  tin-  pilot-vehicle 
' sy.stem;  rad /sec. 

Measurement  frequencies  for  describing  functirin  estimaiion; 
rad /sec . 

60^  Undamped  natural  frequency  of  second-order  component  of  the 
neuromus('U  1 ar  system  describing  function;  rad /set'. 


RMS  value  of^^(t);  the  proposed,  unified  handling 
metric  for  pitch  attitude  tracking;  inciies  (unless 
spec  if ied) . 


RMS  value  of  A (t);  the  proposed,  unified  lianiil  ing 
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1.1  ST  OF  SYMBOLS  (COKTINULD) 


cOjp  Undamped  natural  frequency  of  the  short-period  mode;  rad/sec 


Transfer  Function  Notation 


-(s) 


"S  = X.  (s) 

A(s) 


N^i(s)  Numerator  polynomial  of  the  transfer  function. 


X . 

1 , 


(s)  Denominator  polynomial  of  the  transfer  function. 

O 


SECTION  I 


INTRODUCnON 


Tills  report  addresses  the  iirohlem  of  liow  des4;n  speci  f ieat  ions 
may  be  devised  to  ensure  acceptable  flying  qualities  for  aircraft 
having  arbitrary  airframe  and  control  system  dynamics  and  chat  are 
intended  to  perform  eitiier  conventional  or  unconventional  flight  con- 
trol tasks  requiring  precision  piloted  control. 

It  i.s  well-known  ciiat  the  current  ver.sion  of  the  military  flying 
qualities  specification  M11.-K-8785B  (reference  1)  is  not  totally  sat- 
isfactory for  tiio  design  of  higlily  augmented  aircraft.  It.s  applica- 
bility to  Che  design  of  aircraft  employing  novel  controls  or  control 
system  mechanizations,  or  chat  require  unconventional  piloting  tasks, 
is  questionable.  In  past  design  exercises  where  MIL-F-8785B  was 
strictly  inapplicable,  it  has  been  used  more  as  a design  guide  than 
as  a binding  contracturai  specification.  The  specification  backup 
document  (reference  2),  used  in  conjunction  with  M1L-F-8785B,  has 
been  widely  praised  for  such  purposes.  its  format,  scope,  and  inter- 
pretations of  available  handling  quality  data  bases  enable  the  de- 
signer of  non-classical  aircraft  or  flight  control  systems  to  assess 
specific  designs  from  a general,  state-of-tbe-ari  viewpoint.  The  com- 
bined use  of  MIL-F-8785B  and  its  back-up  documentation  can,  under  ideal 
circumstances,  thereby  provide  the  designer  witli  a flexible  design 
approach  that  may  ensure  satisfactory  flying  qualities  lor  aiverait 
tliat  cannot  otherwise  be  addressed  by  the  handling  qualities  specifi- 
cation, alone. 

There  are  at  least  three  major  difficulties  with  such  an  appriiacb 
to  handling  qualities  design.  First,  many  opportunities  can  arise 
for  different,  equally  plausible  interpretations  of  existing  handling 
qualities  data  bases  and  their  significance  in  the  context  '.a  a non- 
cla.ssical  system  design.  Second,  the  state-of-the-art  isn't  advanced 
enough  to  necessarily  enable  the  a priori  specification  of  satislactorv 
handling  qualities  for  completely  conventional  aircraft;  the  use  of 
available  data  for  unconventional  systems  design  will  Lheretore  be  even 
more  questionable.  Finally,  it  is  difficult  to  (ircpare  . nu t rac  ( u im 1 
agreements  that  bind  a manufacturer  to  quantitative  design  goals  when 
fluid,  and  .somewhat  arbitrary,  de.sign  methods  are  employed  in  the  dc-- 
velopment  of  an  aircraft  system  having  non-classical  dynamics  or  that 
will  be  used  in  tiriconvent  iona  1 ways. 

The  art  of  li.andling  qiialitie.s  is  a viijatile  one.  V.irious  limited 
theories  for  aircraft  liandl ing  exist.  Handling  qualities  data  bases 
are  limited,  sometimes  of  dultinus  wijrtli,  very  expensive  to  accumulate 
and  extend,  and  occasionally  contradictory.  One  practical  difficulty. 
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olten  eiH'ouulureii  hy  t'nose  workiiiy,  in  tlio  Lield,  is  liow  Lo  succc'ss- 
fully  c'oeyisC  viilt  rla'  co;U  r.i'i  ic  t i ons  posed  by  tlie  lack  ol  a unifying 
theory  for  liaiulling  qualitii's,  aiiarsc'  or  conflicting  data,  and  tlie 
necessity  for  the  timeiv  acc  omi')  1 i siiir.on  I of  aircraft  design  and  devel- 
opment functions.  ihe  pres.'^ures  of  system  design  often  demand  an  ex- 
pedient treatment  of  handling  qualities  considerations  during  the 
early  design  stages.  This  is  unfortunate  since  it  is  here  that  han- 
dling quality  considerations  have  their  greatest  potential  benefit  to 
tlie  aircraft  system.  In  future  aircraft  developments  it  may  prove 
too  costly  to  system  performance  and  reliability  to  justify  the  assump- 
tion that  basic  airfrime  handling  quality  deficiencies  can  be  corrected 
during  design  of  the  flight  control  system.  The  imposition  of  global 
system  requirements  such  as  minimizing  life-cycle  costs  or  maximizing 
combat  aircraft  survivability  will,  in  all  llkeliliood,  magnify  the  im- 
portance of  the  handling  qualities  discipline  relative  to  the  tradi- 
tional, dominant  design  technoLogie.s.  At  this  time,  however,  state- 
oi-the-nrt  methods  will  not  support  the  imlusion  of  handling  qualities 
within  an  iterative  nroces.s  of  preliminary  design  optimization  .such  as 
might  be  required  to  meet  such  design  goals.  There  is,  tlierefore,  a 
strong  motivation  for  seeking  a pitysica!  theory  for  aircraft.  Ivandling 
qualities  that  can  unify  exist  iitg  data  bases  obt.ained  from  simulation 
and  flight  test  tiiat  is  acceptal'ie  for  predicting  liandJing  qualities 
in  c i rcumsi ances  for  which  empirical  data  do  not  exist  or  ate  inappli- 
i-able,  and  for  integrating  handling  qualities  into  the  preliminary  de- 
sign process  on  a more  mecliaaisi  ic , user-oriented  basis  titan  is  now 
possible. 

It  is  importatit  to  recognize  that  tlie  present  state-of-the-art 
of  handling  qualities  is  funuarrieni.ally  empirical.  Available  theories 
for  handling  qualities  are  all  based  upon  a network  of  empirical  data, 
experiences  witli  classical  airframe  dynamics,  sc  rvcaiiccli.m  i sms  anal- 
ogies, and  conjectural  hypotheses  wliich  attempt  to  est.ablisii  a connec- 
tion between  iiandling  qualities  and  av.iilable  models  for  iiuman  pilot 
dvnamics.  Ail  these  have  some  demon.st rated  value  for  tlie  codification 
of  experimental  data  and  for  the  design  of  experiments;  ncriic  lias  pro- 
vided significant  insight  into  the  pliysie.s  of  h.indi  ing  qualities  (such 
as,  for  example,  the.  nature  of  human  subjective  responsel  or  has  a 
demon.strated , general  capability  for  relialile  a priori  prediction  of 
handling  qualities. 

The  elusive,  intangible  natute  of  handling  qualifies  iias  pre- 
sented a formiditile  obstacle  to  tlie  development  of  a piiysical  theory 
for  tlie  subject.  I'or  ex.implc.-,  definitions  of  Iiandling  qualities  t.  nd 
to  be  either  personalized  and  vehic  ie-centered  or  general,  vague  .itid 
practlcallv  useless.  It  i.s  conceivable  tiiat  the  nature  ot  Handling 
qualities  transcends  our  abilities  to  define  it  in  simpler  terms.  Tlie 
entire  concept  cf  "quality"  is  invc.-i Ivod : nforonej  27  contains  a pliil- 
osopliical  and  readalile  discourse  on  tlie  subject  of  qiialiti’  and  i.s  rec- 
ommeniied  to  those  who  view  ti'c  sui'ject  as  citlie’'  trivial  or  completely 
obscure . 


rile  lack  of  a suitable  definition  Jnes  not  provent  nn  frujii  rec- 
ognizing  degrees  of  handling  qualities  in  practice.  The  engineering 
problem  is  to  systemat ; c.il ly  rode  these  in  terms  of  airframe  and  control 
system  design  parameters  — this  requires  a suitable  Irindling  metric. 

Pilot  opinion  rating  (FOK)  is  a widely  used  and  poorly  understood 
metric  for  handling  qualities.  It  lias  almost  become  a de  facto  sub- 
stitute for  handling  qualities  through  familiarity  — perhap.s  a classic 
exttmple  of  how  the  measurement  can  become  the  thing  measured.  The 
dynamic  portions  of  MT1-F-8785B  are  based  on  POK  data  accumulated  over 
many  years  from  diverse  source.s.  Ii  is  rerisonable  to  question  the 
policy  of  basing  future  handling  quality  de.sign  requirements  entirely 
on  FOR  in  view  of  the  changing  nature  of  manned  aircraft  combat  roles. 
That,  however,  is  beyond  the  scope  of  the  present  v;ork;  here,  we  seek 
to  evolve  .a  better  under.standing  of  POR  for  tho.se  flight  control  tasks 
and  aircraft  dynamics  that  are  familiar  and  are  encompassed  by 
MIL-F-8785B.  We  wish  to  establish  a piiysical  basis  for  POR,  to  deter- 
mine its  connection  with  task,  system  dynamics  and  .atmospheric  distur- 
bances, and  to  evaluate  means  for  predicting  it  In  tiiose  instances  wiiere 
useful  data  bases  for  handling  qualities  do  not  exist. 

POR  data  often  appear  to  be  highly  variable  and  to  exhibit  unpre- 
dictable, systematic  biases  among  the  pilot  population,  and  random  vari- 
ations for  a given  pilot.  Such  app.'irent  inconsistencies  in  the  handling 
qualities  d.ata  bases  have  been  a factor  limiting  the  introduction  of 
handling  considerations  to  aircraft  preliminary  design.  A major  tenet 
of  the  present  work  is  that  .anomalies  in  the.  POK  data  base  may  be 
illusory.  Witlioiit  a physical  theory  for  b.ar.dling  qualities  land, 
therefore,  for  PDR'i  one  .should  not  .assume  that  all  the  factors  that 
parameterize  POK  .ire  known  for  a given  experimental  configuration. 

Given  tlie  typical  iiandling  quality  experiment  --  simulation  or  flight 
test  --  it  is  a logical  eiror  to  classify  FOR  data  as  inconsistent  or 
variable  merely  because  tlie  same  numeriial  rating  was  not'  achieved  for 
two  or  more  dat.i  runs  w'th  tlie  same  veiii"le  dvnainics.  For  example,  it 
was  once  widely  believed  that  knowledge  of  veliicle  dyn.nmics  would  bo 
sufficient  for  the  deti-rm  i na  t i on  of  POR  to'-  a pre.scribej  task.  Based 
on  tills  belief  it  v;as  e.xpcctid  that  sy.cLe:ii.at  ic  variations  in,  for 
example,  slior L-per lod  dyn.'imics  w.  nld  ptc.itoce  .onsi.steii,  variations  in 
POR  for  a simulation  involving  precision  tr-icking  of  pteb  attitude  — 
regard  les.'s  of  turbulence  ch.irai  t er  i st  li  ■ it  is  now  known  that  tliis  is 
only  approximately  c nn  ; in  fac-,  r i .it  i ons  in  t u rbu  ■ >.  nee  intensity 
with  con.st.nnt  short-period  dvn;)i.;cs  c.-.n  prodLicc  effect  . on  I’OR  is  large 
as  those  obtained  due  to  changes  in  veni'  le  dvnaniice  witn  c<  nstant 
turbulence  intensity  Before  the  s i gni fi c.incc  to  POK  of  turbulence 
was  appreciated,  th'.  I.irge  range  of  measured  Pi'P  obt-iined  without  ex- 
perimental control  of  turbulence  intcn.sitv  w.-is  atirib'ited  Co  'pilot 
variability."  We  rannot  he  cert.iin  t ;i.at  och’r  effects  of  .similiar 
importance  do  not  still  exist.  If  is  clear,  h.iwovi’r,  that  we  s.hould 
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d i spi-'iiiH*  with  tlic  indiscriminate  use  of  "pilot  variability"  as  a 
convenient  cafcli-all  category  for  the  description  of  those  I’OK  data 
that  do  not  fit  our  expectations. 


As  a practical  matter  we  must  expect  that  FOR  data  obtained 
from  a carefully  designed,  realistic  experiment  will  exhibit  a cer- 
tain degree  of  variability.  Wliat  we  need  to  do,  however,  is  to  de- 
velop metliods  for  ensuring  that  the  vaiiability  is  not  the  systematic 
result  of  applying  faulty  theory  or  inadequate  metrics  for  the  corre- 
lation and  assessment  of  POR  data.  A pilot  makes  errors  in  control 
that  we  describe  as  random  because  they  appear  to  be  more-or-less 
random  and  because  we  have  no  model  for  otherwise  explaining  them. 

It  is  conceivable  that  for  some  veliicle  configurations  the  conse- 
quences of  sucli  errors  to  POR  are  significant,  even  though  pilot- 
vehicle  system  dynamics  will  not  be  measurably  affected.  Such  con- 
figurations, when  repetively  evaluated  in  an  experiment,  would  there- 
fore exhibit  apparent  random  variations  in  POR.  Such  variations  in 
POR  would  not,  in  fact,  be  random  if  the  pilot  subjectively  responds 
to  particular  system  properties;  in  that  case  the  POR  data  might  be 
almost  perfectly  consistent  with  a suitable,  but  unknown,  metric  — 
in  other  words  it  is  conceivable  that  it  is  the  engineering  analyst 
and  not  the  pilot  who  establishes  the  level  of  variability  in  POR  data 
Of  course  the  pilot  is  not  a machine-like  evaluator;  run-to-run  vari- 
ations in  POR  of  a genuinely  random  nature  probably  must  be  expected. 
The  Cooper-Harper  scale  lor  POR  is  not  perfect  and  must  be  interpreted 
against  the  experimental  conditions  by  the  evaluation  pilot.  The 
present  state-of-the-art  requires  that  such  effects  be  minimized  by 
averaging  sufficient  POR  data.  We  should  insist,  however,  that  such 
data  be  uncontaminated  by  efiects  that  are  within  our  capability  to 
understand  and  control.  This  is  not  always  so  easy  to  accomplish. 

To  reiterate,  the  apparent  inconsistency  or  variability  that  can 
occasionally  be  seen  in  POR  data  may,  to  a great  extent,  result  from 
attempts  to  establish  correlations  between  POR  and  various  ad  hoc, 
arbitrary  metrics  wiien,  in  fact,  sucli  one-to-one  correlations  may  not 
physically  exist.  In  this  report  it  is  assumed  that  POR  data  — 
properly  obtained  — are  based  on  objective  criteria  (that  may  be  un- 
known) and  can  only  be  understood  or  correlated  with  an  appropriate 
model  for  pilot  dynamics  and  rating  prediction. 

The  prediction  of  pilot  rating  is  presumed  here  to  depend  upon 
the  availability  of  a reasonable  quantitative  model  for  human  pilot 
dvnamics  in  the  handling  qualities  context.  There  are  presently  two 
princ  ipal  models  for  pilot  dynamics  that  have  recieved  general  accept- 
ance as  working  tools  for  the  study  of  pilot-vehicle  system  behavior. 
Principallv,  these  should  be  regarded  as  intcrpol at ive  schemes  for 
rationalizing  certain  available  pilot  dynamic  and  tracking  performance 
data.  Neitlier  the  servo  model  (reference  4)  nor  the  optimal  control 


model  (refereiiee  5)  is  of  particular  value  for  explaining  the  physical 
nature  of  known  trends  in  pi lot-veliic 1 e system  dynamic  behavior. 

Either  is  capable  of  accounting  for  known  trends  a posteriori  tlirough 
adjustment  of  model  parameters  (e.g.,  equalization  in  tlie  servo  model 
or  cost  functional  weighting  in  tlie  optimal  control  model).  The  servo 
model  emphasizes  man-machine  system  dynamics;  the  optimal  control  model 
is  based  upon  raatcliing  man-machine  system  performance  (e.g.,  mean- 
square  tracking  error). 

A piiysical  model  for  pilot-vehicle  systems  analysis,  which  sub- 
sumes the  servo  and  the  optimal  control  models,  and  whicli  is  consis- 
tent with  available  human  response  data,  will  — it  is  anticipated  — 
lead  in  a natural  manner  to  a rational  theory  for  understanding  and 
predicting  FOR.  It  is  further  anticipated  that  a theory  based  upon 
such  a physical  model  will  not  be  married  to  the  limitations  of  empir- 
icism or  controller  task  that  plague  the  Paper  Pilot  approach  to  FOR 
prediction  (as  embodied  in  reference  3). 

A candidate,  unified  model  for  pilot  dynamics  will  be  introduced 
and  discussed  in  this  report.  It  will  be  shown  how  this  conceptual 
model  leads  to  a metric  for  the  correlation  and  prediction  of  POR. 

This  metric  will  be  used  to  explore  the  nature  of  rating  differences 
between  fllgiit  and  simulator  experiments  and  to  examine  the  signifi- 
cance of  attitude  tracking  to  more  general  flying  qualities  tasks.  A 
series  of  demonstrations  will  illustrate  how  revisions  may  be  devel- 
oped to  MIL-F-8785B. 

It  should  be  noted  that,  throughout  this  report,  the  pilot  output 
is  expressed  in  terras  of  control  deflection  rather  than  control  force. 
This  has  been  done  merely  for  compatibility  with  the  principal  data 
sources  for  human  pilot  dynamics  as  they  presently  exist.  Most  meas- 
urements of  pilot  dynamics  have  been  obtained  from  fixed-base  .simu- 
lation experiments  with  rudimentary  controls  for  which  deflection  and 
force  were  proportional.  For  some  data,  there  was  no  control  restraint 
and  we  must  express  the  pilot's  response  as  a deflection.  In  those 
numerical  examples  in  Sections  IV  and  V,  using  the  Kleinman  model,  the 
control  system  displacement  gain  (the  ratio  of  surface  to  control  stick 
deflections)  is  assumed  to  be  combined  with  the  control  effectiveness 
derivative;  it  is  the  overall  pitching  inoment-to-control  stick  gain 
that  is  assumed  to  be  optimized  prior  to  estimation  of  the  POR  metric 
proposed  in  this  report.  It  is  probably  true  that  no  general  tlieory 
for  handling  qualities  can  neglect  the  force-displacement  interactions 
between  the  pilot's  neuromusuclar  system  and  the  aircraft  feel  system; 
that  has  been  done  in  this  report  only  because  it  is  believed  that  the 
necessary  data,  mathematical  models,  and  physical  understanding  of 
neuromuscular-feel  system  interactions  do  not  yet  exist.  The  potential 
importance  of  the  feel  system  to  the  prediction  of  handling  qualities 
has  been  appropr i ately  emphasized  at  various  points  throughout  this 
report . 
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SKCTION  II 

A UNIFIED  MODEL  FOR  PILOT  DYN,\MICS  IN  SINGLE  LOOP  TRACKING 
PART  I:  THEORY  AND  BASE-LINE  ANALYSIS 


A.  BACKGROUND 


There  has,  since  WWI I , been  sustained  interest  in  quantifying  the 
contributions  of  a pilot  to  the  overall  closed  loop  pilot-vehicle 
system's  dynamic  response.  Research  in  this  area  has  produced  two  out- 
standing models  for  human  pilot  behavior  in  a closed  loop  system.  The 
first  and  most  tlioroughly  documented  is  the  servo  model.  It  has  received 
wide  attention  and  has  enjoyed  a record  of  successful  applications  in 
several  areas  of  aircraft  system  analysis  and  design.  Reference  6 is 
a recent  summary  of  the  general  state  of  the  art  of  pilot-vehicle  systems 
analysis  which  emphasizes  the  significance  of  the  servo  model.  Appli- 
cations of  state-space  formalisms  and  the  principles  of  optinial  control 
have  produced  the  more  recent  optimal  control  model  for  pilot-vehicle 
systems  analysis  (reference  5) . Both  models  have  their  particular  merits 
and  adherents.  Both  are  linear,  time-invar iant , and  tend  to  be  of  about 
equal  value  for  analysis  when  applied  by  experts  in  their  usage. 

The  approach  that  produced  the  servo  model  was  to  hypothesize 
a servo-like  operation  on  a single  stimulus  (system  error)  by  the  human 
pilot,  parameterize  a servo-mechanism  model  for  his  dynamic  response, 
conduct  a program  of  simulation  and  measurement,  and  extract  the  servo 
model  parameters  from  these  data  for  each  control  configuration  tested. 

The  classic  experiments  documented  in  reference  4 were  conducted  using 
a sequence  of  exemplary  vehicle  dynamics  that  were  hypothesized  to 
encompass  the  dynamic  character  and  range  of  airplane  - control  system 
dynamics  of  interest  to  manned  flight.  The  result  of  this  program  was  a 
catalog  of  pilot  model  and  closed  loop  system  parameters  as  functions  of 
system  input  and  controlled  element  dynamics  - - all  for  the  single  piloting 
task  of  continuous  closed  loop  tracking  with  a single  visual  display  of 
tracking  error  (figure  1).  A set  of  "adjustment  rules"  were  developed  to 
guide  the  user  in  the  selection  and  adjustment  of  pilot  model  parameters 
according  to  the  specifics  of  a particular  application. 

The  servo  model  for  human  pilot  dynamics  was  originally  developed 
under  a set  of  severe  restrictions  which  are  almost  never  entirely  sat- 
isfied in  practical  flight  control  tasks.  These  include: 

1.  The  system  input  is  of  low  bandwidth  and  i.s  random  appearing 
with  invariant  statistics. 

2.  The  a irpl  ane/d  ispl.ay  system  dynamics  are  1 ine.ar  and  time- 
invariant  . 
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3.  The  system  has  a single  input  with,  a compensatory  display 
of  system  error, 

4.  The  pilot's  response  is  tlirough  a single  controller. 

5.  The  pilot's  task  is  to  track  system  error  in  some  sense 
analogous  to  minimizing  mean  square  error. 

6.  The  pilot's  cues  are  entirely  visual . 

Ad  hoc  assumptions  are  often  used  to  extend  tlie  servo  theory  to  encompass 
a broader  range  of  conditions  of  more  practical  interest.  These  include 
multiple  loop  control  tasks  (e.g,  hover  over  a spot,  approach  and  landing 
control,  etc.),  tracking  witliout  command  inputs,  effects  on  pilot  dynamics 
of  vehicle  motion,  use  of  multiple  controls,  and  control  of  multiple 
axes  of  vehicle  motion. 

There  Is  a two-fold  difficulty  with  the  ad  hoc  approach  to  pilot 
modeling  and  its  application  to  handling  quality  analyses.  First,  there 
has  been  an  historic  tendency  by  the  handling  qualities  communit'’  to  view 
the  representation  of  human  controller  functions  with  differential 
equations  as  a sheer  novelty  and  to  uncritically  accept  even  small 
successes  in  human  operator  modeling  without  concern  for  unity  of  modeling 
and  understanding.  The  effect  of  this  atmosphere  is  to  remove  any  sense 
of  urgency  for  a more  critical  search  for  alternative  explanations  for 
human  pilot  behavior  that  might  lead  to  broader,  more  unified  understanding; 
it  is  safer  to  promote  and  sponsor  low-risk  (and  low  payoff)  research. 

Second,  the  permissive  attitude  that  embraces  the  ad  hoc  philosophy  leads 
inevitably  to  the  misuse  of  carefully  documented  baseline  theory  such  as 
reference  4 and  to  the  development  of  faulty  theory  for  the  prediction 
of  handling  qualities.  In  mathematics,  an  hypothesis  is  rejected  fcr 
all  time  if  it  is  shown  to  fail  for  one  test  case.  This  same  logic  is 
seldom  applied  in  the  development  of  a theory  for  handling  qualities. 

Failure  of  pilot  opinion  rating  to  satisfy  a prescribed  theoretical  metric 
for  its  correlation  is  inevitably  blamed  on  the  "variability"  of  pilots 
and  almost  never  on  the  metric,  its  underlying  theory,  or  the  experimental 
design . 

Methodical  extensions  of  the  single  loop  servo  theory  for  pilot-vehicle 
dynamics  to  multiple  loop  control  tasks  or  to  account  for  motion  effects 
have  been  attempted.  These  have  not  met  with  the  same  degree  of  success 
as  has  the  single  loop  theory.  in  fact,  a consistent,  methodical  approach 
which  addresses  all  the  conceivable  effects  of  input,  display,  controller, 
task,  and  vehicle  parameters  may  be  impractical  within  the  context  pro- 
vided by  the  servo  theory  for  pilot  dynamu’s.  We  lack  a scheme  for 
ra t i onal i z i ng  all  the  conceivable  higher  order  control  situations  of  piactical 
interest  and  for  parameterizing  a pilot  model  suit.'ible  for  all.  In  short, 
the  problem  has  too  m.any  dimensions  to  lend  itself  to  a direct  experimental 
study.  The  state-of-the-art  of  the  servo  model  is  now  .such  that  it  can  be 
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fXfeiKleu  to  moro  (.’ontrol  tasko  only  l>v  si  r.ippinj'-on  additional 

.1(1  hoc  comp  1 i(.  at  tons.  fine  wonders  wncthcr  a simpjer  ,ind  more  fijnda- 
ment.il  approach  might  not  exist. 

A raort;  mechan  i .St  ic , if  not  simpl.:',  approtich  to  huntiri  i>iiot  mcjdeling 
is  described  in  reference  5.  The  optimal  C(..ntrol  model  for  pilot-vehicle 
dynamics  - - widely  known  as  the  Kloinman  model  after  its  principal 
oriptinaCor  - - i.s  bas'od  upon  tlie  a.s.snmpl  i(')n  that  human  controller  response 
is  near-optimnm  in  some  sense  and  is  essentially  linear.  I’he  character 
of  optimisation  theory  led  in  a natural  manner  to  formulation  of  the  governing 
system  equations  in  terms  of  state  variables.  Tlie  state  vector  components 
are  selected  by  the  analyst  to  simulate  the  various  feedback  cues  actually 
available  to  the  liuman  pilot.  Normally,  these  include  vehicle  attitudes 
and  attitude  rates  for  visual,  fixed-base  tracking  and  rotational  or 
linear  accelerations  if  motion  cue  effects  are  to  be  modeled.  The 
modeling  of  multiple  loop  tracking  tasks  will  usually  require  that  tra- 
jectory variables  and  their  higher  order  derivatives,  as  nay  be  sensible 
by  the  human  pii(jC,  be  included  within  the  state  vector.  In  the  .simplest 
fixi?d-basc  tracking  task,  with  a visual  display  of  system  etror,  the 

Kieinman  model  will  usually  be.  chosen  such  that  the  information  vector  is 

system  error  and  error  rate  (figure  2). 

It  snouid  be  noted  that,  even  in  single  loop  visual  tracking,  the 
Kieinman  model  treats  tlie  information  available  to  the  human  pilot  model  as 
a vector  quantity  f(jr  convenience;  i.e.,  it  is  consistent  with  state  space 
formalisms.  There  is  no  evidence  that  any  physical  importance  was  initially 
attached  Co  this  assumption.  Rather,  it  was  done  to  prov/ide  continuity 
with  the  servo  model's  lead  equalisation  requirements.  That  is,  the 
generation  of  lead  by  the  servo  model  is  considered  to  be  synonymous  with 
the  feedback  of  error  rate  in  the  Kieinman  model . This  does  not  necessarily 
have  CO  be  true  but  need  not  concern  u.s  at  this  point  in  this  report. 

What  is  of  concern  here  is  the  possibility  that  control  informatjon  is 

assimilated  by  the  human  ns  thougli  it  were  a vector  quantity  - - 

that  is,  the  formal  treatment  of  operator  input  by  the  Kieinman  model  may 
be  a reasonable  model  for  the  physical  process  (at  least  in  a linearized 
sense) . 

The  Kieinman  model  delays  each  feedback  v.ariable  by  an  amount  t 
seconds  which  must  be  pre-set  by  the  analyst.  An  "observation  noise,"  linear! 
uncorrelated  with  sy.stem  input,  is  injected  into  each  feedback  variable.  Each 
noisy  feedback,  delayed  by  t seconds,  is  then  fed  to  a Kalman  filter , which 
estimates  the  feedback  state  In  the  presence  of  noise,  and  then  to  a predictor 
which  uses  ail  feedback  variable;;  to  predict  the  value  of  each  state  variable 
at  the  time  t -l-  T (i.e.  it  tries  to  remove  the  eftect  of  the  time  delay). 

The  injection  of  "observation  noise"  is  essential  if  the  model's  predictions 
of  system  performance  are  to  he  realistic.  if  it  were  omitted,  then  the 
Kalman  filter  and  the  predictor  would  yield  a perfect  estimate  of  the 
system's  state  for  use  bv  the  optimal  controller  and  the  model's  performance 


woliili  be  far  superior  fo  die  liiinian  pilot's.  The  predictor  yi  Ids  a 
vee>or  of  perceived  state  variables  wliich  is  operated  on  by  t Jje  optiin.il 
centrolier  algoritlim  to  produce  ttie  optimum  feedback  nains,  K . A 
final  noise  component,  "motor  noise,"  is  injected  at  the  contfoj ^point 
to  account  for  tlie  remainder  of  the  human  pilot's  nonlinear  irr  nnn- 
stat  ionary  dynamics. 

The  optimal  controller  operation  in  the  Kleinman  model  adjusts  the 
feedback  gains  to  minimize  a cost  functional  (e.g.  see  figure  2).  in 
practical  applications,  the  cost  functional  is  a linear  combination  of 
mean-sqnare  values  of  various  system  signals.  Tlie  weights  in  the  cost 
functional  are  selected  to  yield  the  best  match  between  model -pred ic ted 
and  experimental  values  of  system  performance  measures  (usually  mean- 
squared  tracking  error) . 

A principal  area  of  concern  in  applying  the  Kleinman  model  is  that 

the  cost  functional  weights  must  be  varied  according  to  changes  in  vehicle 

dynamics,  display  mechanization,  vehicle  disturbance,  or  task  requirements. 
If  this  were  true,  then  the  model  would  be  of  little  real  value  for 
predictions  of  system  behavior  in  the  absence  of  an  extensive  data  base. 
Fortunately,  this  may  not  be  the  case.  Reference  23  suggests  that,  for 
the  same  or  similar  task  constraints,  weiglits  derived  for  one  rel i.able 
data  source  may  be  invariant.  This  matter  will  be  re-examined  later 
in  this  report  (Section  IV). 

The  choice  of  either  the  servo  or  the  Kleinman  model  for  the  analysis 

of  .single  loop  tracking  tasks  (such  as  those  shown  in  figures  1 or  2)  is, 

to  some  extent,  a matter  of  personal  preference.  It  is  true,  however, 
that  the  servo  model  was  developed  as  a tool  for  explaining  the  pilot's 
role  in  influencing  closed  loop  system  dynamics . It  was  believed  that 
understanding  of  pilot-vehicle  system  dynamics  gained  from  applications  of 
the  servo  model  would  lead  to  a theory  for  handling  qualities  that  would 
permit  quantitative  predictions  of  his  subjective  evaluation  of  sy.stem 
suitability.  The  Kleinman  model,  on  the  other  hand,  was  developed  as  a 
tool  for  predicting  tracking  performance  ot  a closed  loop  pilot-vehicle 
system  without  particular  reg.trd  for  system  dynamics.  However,  the  Kleinman 
model  can  be  used  for  the  prediction  of  system  dynamics  and  the  servo  model 
is  usable  for  predicting  system  performance.  Nevertheless,  the  initial 
selection  and  adjustment  of  model  parameters  is  usually  done  on  the  ba.sis 
of  matching  system  dynamics  with  the  servo  model  and  system  per f orm.-'.nce  with 
the  Kleinman  model. 

Applications  of  the  servo  model  to  the  analysis  of  handling  quality 
tasks  involving  higher  levels  of  control  such  as  multiple  loop  or  multiple 
axis  tracking  requires  'ons iderabl e fnmiliaritv  and  skill  with  the  single 
loop  servo  model  plus  a certain  .nmount  ol  artistry.  For  such  ta.sks  a 
major  part  of  the  analy.sis  problem  is  to  select  a reasonable  structural 
form  for  the  pilot  model  (e.g.  Wh.nt  arc  the  feedback  variables?  What  are 
the  equalization  requirements?  WTiat  control  cross-feeds  apply?  etc.?). 
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not  necessarily  an  aid  to  tlie  development  of  more  extensive  and  accurate 
st?rvo  descriptions  of  Human  pilot  dynamics.  It  is  often  not  possible  to 
directly  measure  tlie  servo  model  elements  by  experimert,  as  can  be  done 
in  single  loop  tracking,  because  of  uniqueness  difficulties  (reference  7). 
By  contrast,  it  has  already  been  indicated  that  the  Kleinman  model  may 
be  applied  to  such  tasks  with  relative  ease  (at  least  in  concept)  without 
procedural  or  structural  change  beyond  the  addition  of  new  state  variables 
and  introducing  new  observation  noise  components  for  each. 
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In  fact,  the  practical  situation  is  such  that  either  the  servo  or  the 
optimal  control  model  can  be  applied  to  the  same  problem  with  about  equal 
probability  for  success  and  witli  about  the  same  result.  Both  are  linear 
models.  Both  are  parameterized  to  replicate  different  features  of  the 
same  experimental  data  base.  Many  experimental,  programs  over  the  past 
two  decades  have  establislied  the  essential  validity  of  the  linearity 
assumption  for  the  pilot's  dynamic  response  in  exemplary  tracking  tasks. 

The  vetricle,  display,  and  trajectory  dynamics  are  typically  linear,  or 
nearly  so.  An  optimality  criterion  exists  to  permit  the  dynamics  of  any 
linear  system  to  be  "explained"  with  an  optimal  control  model.  Thus,  the 
"adjustment  rules"  for  the  parameterization  of  the  servo  model  can  be 
visualized  as  the  frequency  domain  equivalents  of  the  cost  functional  and 
its  weights  in  the  Kleinman  model. 

There  is  a tendency  by  those  working  in  the  handling  qualities  field 
to  forget  that  these  models  are  fundamentally  empirical.  Botl'.  were  derived 
as  expedient  tools  for  assessment  of  empirical  re  la  f ionsli  ips  between  t)ie 
pilot  and  his  control  environment.  Neither  is  necessar i ly  a physiologically 
acceptable  model  for  human  behavior.  No  pnl losoph ical  basis  for  the 
correctness  of  either  model  tias  yet  to  be  established  on  rigorous  grounds. 

Both  models  depend  for  their  successful  application  upon  tiie  existence  of 
base-line  data  for  tlieir  parameterization.  In  tiiis  sense,  tliey  are  inter- 
polative  models.  Wliat  we  require  for  handling  quality  applications,  especially 
for  examining  design  specification  requirements,  are  predictive  models  for 
use  in  the  absence  of  data. 

The  remainder  of  this  section  will  adaress  the  problem  of  how  our 
understanding  of  human  pilot  dynamics  may  be  vinified  by  developing  a 
new  model  which  subsumes  the  servo  and  optimal  control  descriptions  of 
his  behavior  in  manual  tracking.  The  point  in  doing  this  is  not  to  de- 
velop better  techniques  for  predicting  pilot  dynamic  response,  per  se . 

Rather,  we  anticipate  that  a physically  realistic  model  for  human  pilot 
dynamics  will  suggest  a method  for  the  prediction  ol  pilot  opinion 
rat ing. 
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B. 


TWO  HYPOTHESES 


The  following  two  hypotheses,  witli  a dtsc'ussion  of  each,  are  presented 
here  as  guides  in  the  search  for  a unified  theory  for  human  pilot  dynamics. 
Neither  hypothesis  has  been  entirely  validated.  The  reader  may  draw  his 
own  conclusions  about  their  value  after  digesting  the  remainder  of  this 
report . 

HYPOTHESIS  1 


The  servo  and  the  optimal  control  models  for  human  pilot  dynamics  are 
linearizations  of  a more  fundamental  nonlinear  model.  The  measurable 
variations  in  servo  or  optimal  control  model  parameters  with  changes  in 
controlled  element  or  forcing  function  can  be  partly  explained  as  operating 
state  changes  in  the  nonlinear  model  rather  than  by  attributing  them  entirely 
to  manual  adaptation,  per  se. 

HYPOTHESIS _2 

A model  for  human  pilot  dynamics  that  structurally  matches  the  human 
physiology  involved  in  the  tracking  process  will  lead  to  a natural  measure 
for  pilot  opinion  rating. 

P/ISCUSSION 


Neither  the  servo  nor  the  optimal  control  model  offers  an  explanation 
for  why  tiie  model  or  closed  loop  parameters  vary  with  system  changes.  It 
is  known,  for  example,  that  closed  loop  phase  margin  and  cross-over  frequency 
vary  systematically  with  controlled  element  (vehicle)  dynamics  and  that  this, 
in  some  way,  reflects  task  difficulty.  Forcing  function  bandwidth  has  a 
strong,  consistent  effect  on  phase  margin.  The  portion  of  the  human  con- 
troller's response  that  is  not  linearly  correlated  with  system  input,  the 
remnant,  appears  to  be  dependent  upon  both  input  statistic.s  and  controlled 
element  dynamics.  Increasing  input  cut-off  frequency  beyond  about  80  percent 
of  the  cross-over  frequency  produces  a discontinuous  reduclion  in  system 
cross-over  frequency  (the  so-called  co^  regression  phenomenon).  Tlie  dis- 
tribution of  control  stick  motions  becomes  notably  bi-modal,  indicative  of 
controller  "pulsing,"  for  certain  controlled  elements;  the  effect  is  modeled 
with  either  the  servo  or  optimal  control  model  as  an  increase  in  remnant. 

The  generation  by  a human  operator  of  lead  equalization,  as  required  in  the 
servo  model  and  accounted  for  in  Kleinman's  model  with  a rate  feedback  path, 
is  intuitively  acceptable  to  most  of  us.  However,  lag  generation,  which  the 
servo  model  description  requires  for  a particular  class  of  controlled 
elements  (pure  gain),  is  not  intuitively  satisfactory  to  this  author. 

Reference  4 documents  all  these,  and  otlier,  empirical  trends  for  the 
■single  loop  tracking  task  within  the  context  of  the  servo  theory.  No  similar 
exper 'raent.al  program  of  the  comprehensiveness  of  that  described  in  refer- 
ence 4 
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has  evt-r  bi'fn  aci'omii ! i sliod  tor  tin.'  oiiLimal  ooruriil  model  - - altliou^h 
spoL-c  hecks  have  been  nuide. 

Empirical  models  lor  the  data  base  provided  by  reference  4 have, 
a.->  previously  indicated,  proven  very  useful  for  predicting  system  dynamics 
and  performance  in  many  pructicai  applications.  However,  it  is  reasonable 
to  expect  dial  a model  capable  of  explaining  the  physical  origins  of  the 
dat.i  trends  will  readily  lend  itself  to  identification  of  the  limits  of 
applicability  ol  the  servo  and  optimal  control  models  and  to  establishing 
the  necessary  and  sufficient  conditions  for  tiieir  use.  That  is,  if  the 
Servo  and  Kleinman  model s are  reasonable.,  parochial  descriptions  for 
human  pilot  dvnamics,  then  a more  fundamental  model  will  subsume  these. 

In  addition,  a pilot  model  that  is  more  accurate  than  these  in  physiological 
details  should  permit  a more  rationalized  and  less  artistic  approacli  to 
including  effects  due  to  liiglier  order  control  tasks,  motit)n  cues,  effects 
of  turbulence  intensity,  and  so  forth. 

There  is  reason  to  believe  that  at  least  some  of  the  variations  in 
human  pilot  dynamics  are  Lite  result  of  nonlinear  physical  mechanisms  internal 
to  the  human  systeit.  it  is  reasonable,  ti.en,  to  invent  the  first  hypothesis, 
if  it  can  be  validated,  it  would  permit  the  decoding  of  the  process  of 
manual  adaptation  to  an  extent  not  heretofore  possible.  It  would  also 
provide  a model  for  the  automatic  prediction  of  human  pilot  remnant  (or  at 
least  a large  pari  of  it)  as  well  as  providing  n unified,  predictive  model 
applicable  to  very  general  flight  control  tasks  and  to  the  evolution  of  a 
realistic,  theory  for  handling  qualities. 

Any  usable  theory  for  handling  qualities  must  incorporate  a method 
tor  the  qtiant i tacive  prediction  of  pilot  opinion  rating.  It  is  not  enough 
to  predict  system  dynamics  and  tracking  performance.  The  prediction  of 
opinion  ratings  must,  how'ever,  derive  from  a sound  physical  basis  and  hope- 
fully he  closely  Lied  with  a reliable  model  for  human  pilot  dynamics.  It  is 
nut  sufficient  to  base  the  prediction  method  on  statistical  models,  devised 
with  a set  of  experimenfai  data,  in  the  absence  of  a general  physical  theory 
for  the  nature  of  the  rating  process.  The  second  hypothesis  formalizes 
tills  philosophy  and  re-af firms  the  author's  belief  that  a rational  and 
physical Iv-or i ented  basis  exists  for  tlie  pilot's  "manufacture”  of  his  opinion 
rat ing. 

C.  A NONhiNEAR  TIME  DELAY  MtiDEL 


the  vK'wpoiaL  hero  is  th.iL  a uni;  i od  model  tor  liuman  pilot  dvnainies  is 
attainable  oniy  if  one  is  prepared  te.  address  the  possibility  that  a human 
controller's  non  I inear  i t i es  are.  at  tlie  rout  of  his  most  interesting,  useful, 
yet  most  baffling  behavior.  Still,  where  doe:;  one  begin  Che  search  for  a 
suitable  nonlinear  model? 

A systematic  search  for  a unilied  nonlinear  model  ior  human  dynamics 
that  considers  all  possible  non  I.  i near  1 1 i es  w:ithout  consideration  for  known 
phy.sit.al  properties  of  the  human  it;ec'b.inism  or  of  the  describing  function 
(servo  model)  data  base  as  it  exists  is  not  likely  to  succeed.  There  are 
too  many  pos.s  ib i 1 it  ios  to  consider  and  the  beliavior  of  even  simple  non- 
linearities  i ,s  Loo  difticult  to  .systematize  in  the  ab.sence  of  guideline 
physical  criteri.a. 

Certain  general  properties  of  the  human  controller  in  closed  loop 
tracking  tasks  are  known  and  can  he  used  to  evaluate  candidate  nonlinear 
pilot  models.  For  example,  the  combinations  of  system  input  and  controlled 
element  dynamics  that  guarantee  closed  loop  stability  are  generally  known 
(and  here  we  purposely  ignore  the  problem  of  catastrophic  pilot-induced 
ose, i 1 lat ions)  or  can  be  deduced  with  the  aid  of  the  servo  model  for  pilot- 
vehicle  systems  analysis.  Provided  one  is  familiar  with  the  experimental 
data  base  for  manual  tracking  experiments,  then  the  general  character  of 
the  human  controller's  response  is  known  as  a function  of  controlled  element 
dynamics;  e.g.  we  have  general  knowledge  about  whether  his  rc-sponse  should 
be  smooth  or  pulse-like,  what  tire  d is  tr  i but  iirn  of  control  deflection  will 
be,  and  of  the  frequency  content  of  the  control  response. 

The  arguments  used  by  this  author  to  justify  ttie  approach  documented 
on  these  pages  are  quite  circular  and  involve  more  than  a little  intuition. 

The  essential  defense  offered  for  this  approach  is  that  it  is  the  result  of 
several  years  of  study  of  the  reference  4 data  base  and  appears  to  be 
self-consistent.  That  is,  each  nonlinearity  introduced  here  appears  to  offer 
the  potential  for  rationalizing  some  facet  of  the  experimental  data  without 
creating  new  inconsistencies  or  requiring  additional  assumptions. 

A nonlinear  multiple  loop  model  for  pilot  dynamics  will  be  proposed 
later  in  tliis  :-:ecLion.  A nonlinear  time  delay  in  the  rate  sensor  mechanism 
will  comprise  an  essential  nonlinearity  in  this  model.  I'he  attributes  of 
an  amplitude-dependent  time  delay  will  be  discussed  in  the.  rem.ainder  of 
this  art  icle. 

Brissenden  (reference  8)  measured  the  iatenev  time  delays  incurred 
in  hiimcai  sen.sntion  of  visual  r.tte.  ilio  experiment  described  in  that  reference 
is  not  directly  ,ipplioablc  to  t!ie  problem  of  l■losecl  loop  tracking:  it  does, 
however,  establish  tliat  the  time  delay  involved  in  the  detection  by  a human 
of  a rate  stimulu.s.  given  only  a visual  display,  is  generally  dependent  upon 
the  stimulus  magnitude.  Representative  data  from  reference  8 are  shown 
on  figure  1.  These  data  are  un iortuna t e 1 v not  quantitatively  .suitable  for 
further  analysis. 
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The  data  of  reference  8 proraptod  tlie  derivation  of  a model  for 
the  direct  visual  sensation  of  rate  in  reference  9.  insofar  as  possible, 
this  model  considers  the  phvsiolo^ty  of  the  pliysical  process  in  visual 
detection  of  a stimulus'  rate  of  change.  Its  principal  valiii  is  to 
establish  a physical  basis  for  an  amplitude-dependent  time  delay  in  rate 
detect  ion. 

Both  references  8 and  9 are  consistent  in  their  indication  of  a 
hyperbolic  variation  of  time  delay  with  rate  amplitude.  Tliis  variation 
was  determined  for  step  changes  in  rate;  however,  it  is  possible  to  show 
by  example  that  the  detailed  relationship  between  rate  x and  time  delay 
V probably  isn't  of  qualitative  Importance  to  system  time  response 
characteristics  so  long  as  x decreases  with  increasing  x and  vice  versa. 
In  all  the  work  discussed  in  this  report  the  hyperbolic  variation  is  assumed: 

K 

X = 1 I , K = constant 

lx) 

No  discussion  of  the  general  properties  of  a nonlinearity  of  this  form 
exists,  to  the  author's  knowledge,  in  the  literature.  Figure  4 indicates 
some  of  the  more  basic  time  response  effects  that  can  be  produced  by  a 
nonlinear  delay. 

It  is  assumed  that  the  delay  is  symmetrical  with  respect  to  the  sign 
of  the  rate  change.  Thus,  the  pulse  width  of  a stimulating  rate  is  pre- 
served by  tlie  nonlinearity. 

A sequence  of  pulses  will  be  transf or'med , such  that  the  delayed  response 
contains  a decreased  spacing  between  successive  stimulus  peaks  w'nen  the 
rate  amplitudes  successively  increase  and  vice  versa  (da  of  figure  4). 

However,  the  amplitudes  of  the  stimulus  pulses  are  unaffected  by  the  trans- 
formation. If  one  stimulus  pulse  is  followed  closely  enough  by  anotlier  having 
a significantly  greater  amplitude  then  the  delay  will  invert  the  order  of  the 
input  pulses  as  shown  In  2b  of  figure  4.  It  will  be  assumed  in  the  i)resenf 
work  that  the  physical  interpretation  of  this  behavior  is  that  the  smaller 
pulse  is  never  detected  by  the  human  sensor. 

A sinusoidal  rate  stimulus  will  be  transformed  by  a delay  of  this  form 
into  a periodic  signal  tiiat  looks  mucii  like  a square  wave  (sketch  3 of 
figure  4).  A sinusoidal  describing  function  for  the  nonlinearity  would  he  a 
unit  gain  (since  response  and  stimulus  amplitudes  r.re  equal)  plus  a phase  lag 

tp  = u>X  , radians 


From  tUo  above  discussion  it  sliould  be  obvious  tiiat  a nonlinear  delay  o£ 
the  io rni  assumed  will; 

1.  introduce  discontinuities  in  tlie  output  when  large,  Iiigh-f requency 
changes  occur  in  the  input, 

2.  steepen  input  ramps, 

3.  elongate  input  "tails", 

4.  not  affect  input  amplitudes,  except  possibly  in  a local  sense 
when  small  peaks  may  be  eliminated  due  to  the  pulse  inversion  process 
discussed  above  and, 

5.  produce  an  input-output  phase  angle  relationship  that  is  dependent 
on  tlie  local  time  delay. 

It  is  believed  and  is  hereby  postulated  that  a nonlinear  time  delay 
of  Che  above  or  similar  form  will  serve  as  a principal  factor  in  explaining 
the  origins  of  certain  of  the  data  trends  shown  in  the  data  base  of  reference 
4.  In  particular,  it  is  reason.ible  to  expect  that  a nonlinear  delay  will 
account  for: 


1.  the  pulse-like  character  of  control  response  for  certain  of  the 
controlled  elements  that  are  classified  as  difficult  to  control  (the  amplitude 
distributions  of  control  contain  a blmodal  component  for  these  cases). 


2.  the  production  of  remnant  that,  in  reference  4 and  elsewhere  has 
been  attributed  to  random  fluctuations  in  reaction  time  delay. 

3.  the  variations  in  effective  time  delay  with  the  controlled  element 
or  input  descriptions. 


4.  the  variations  of  closed  loop  phase  margin  with  input  statistics 
and  controlled  element  dynamics. 

5.  certain  of  the  inter-operator  differences  previously  attributed 
to  "s tvlc . " 


6.  the  lagging  low-frequency  phase  angles  that  appear  in  almost 
all  describing  function  measurements  of  human  operator  dynamics. 

The  nonlinear  delay  will,  of  course,  be  imbedded  in  a closed  loop 
system  which  purports  to  model  pilot-aircraft  system  dvnamics.  The  input 
•in  the  delay  element  will  be  the  i Losed  loop  system's  error  rate.  This 
.signal  will  be  .shaped  by  the  nonlinearitv  allied  with  the  dynamic  response 
of  tne  remaining  system  elements.  In  general,  if  the  system  were  entirely 
linear  with  good  tracking  dynamics  and  with  low  frequency  command  or 
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disturbance  inputs,  the  closed  loop  equations  would  indicate  that  the 
power  content  in  closed  loop  error  rate  is  most  signilicant  at  fre- 
quencies from  slightly  below  crossover  to  the  effective  bandwidth  of 
system  input  and  mucii  smaller  at  lower  or  higher  frequencies.  This  ob- 
servation is  depicted  in  tlie  generic  sketches  of  figure  5.  Tlie  system 
input  power  spectral  density  iriustrated  in  figure  5 is  representative 
of  those  used  in  the  servo  model  validation  experiments  documented  in 
reterence  4 as  wall  as  in  many  subsequent  programs  of  analysis  or 
exper iment . 

A closed  loop  system  liavlng  poor  servo  performance  will  tend  to  have 
more  error  power  content  at  frequencies  below  the  crossover  frequency, 
ibis  will  magnify  the  peak  in  the  error  rate  spectra  and  substantially  in- 
.rease  the  error  rate  signal  level  for  a constant  inotit  spectrum. 

It  is  plausible,  based  on  the  closed  loop  observations  above,  to 
speculate  that  the  frequency-dependent  amplitude  of  the  error  rate 
spectral  components  together  with  the  amplitude-dependent  time  delay, 
could  account  for  tlie  data  trends  noted  above  provided  the  overall  model 
for  pilot-vehicle  system  dynamics  can  be  appropriately  structured.  The 
connection  between  the  Bode  amplitude  plot  jC^<jco)j  and  Che  corresponding 
phase  relation  between  S (t}  and  c(t)  should  be  noted,  in  particular.  In 
regions  where  is  small  (e.g.  the  low  and  high  frequency  regions 

depicted  in  Figure  5)  the  nonlinear  delay  will  be  large  and  the  equivalent 
phase  lag  will  be  substantial.  It  should  also  be  evident  that  when  the 
closed  loop  error  rate  response  is  near-periodic  as,  for  example,  when  the 
system  phase  margin  is  very  small,  the  time  delay  produced  by  the  nonlinear 
delay  will  be  nearly  constant. 

The  mathematical  treatment  of  an  amplitude-dependent  time  delay  is 
extremely  complicated  and  beyond  the  scope  of  this  report.  For  present 
purposes  it  is  sufficient  to  present  a digital  computer  model  for  the 
delay  and  use  it  in  the  simulation  of  candidate  nonlinear  models  for  the 
human  pilot.  The  details  of  this  development,  with  a flow-ctiart  and  a 
program  listing,  are  given  in  Appendix  A. 

The  innocuous  appearance  of  a hyperbolic  variation  of  delay  with  error 
rate  magnitude  belies  the  complexity  involved  in  its  simulation  with  a 
digital  program.  Basically  an  output  file  must  be  created,  given  the  input 
to  the  delay,  and  updated  according  to  whether  or  not  the  output  storage 
is  to  be  overwritten  as  in  case  2b  of  figure  4.  The  response  from  the 
delay  is  then  determined  by  interpolation  on  the  output  file  at  Che  time 
of  entry  to  the  delay  element. 

A major  programming  difficulty  is  to  enstire  compatibility  between 
tlie  delay  model  and  that  for  the  rest  of  the  pilot-vehicle  .system.  In 
particular,  the  requirements  peculiar  to  the  numerical  integration  algorithm 
must  be  carefully  considered.  A predictor-corrector  scheme  was  used  in 
the  present  work.  Tims,  the  nonlinear  delay  model  incorporates  features 
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to  permit  chjnges  in  time  step  size  and  to  allow  the  back-spacing 
of  simulation  time  as  is  ocoaslotial  1 y necessary  wit'-,  sucli  an  integra- 
tor. Special  checks  are  also  required  in  the  model  to  ensure  that 
sufficient  storage  exists  in  the  output  file  to  permit  the  numerical 
interpolation  required  to  calculate  the  actual  output  at  a given  time. 

The  final  luodel  documented  in  Appendix  A is  believed  to  be  a 
reasonable  representation  of  the  physical  process  discussed  above.  It 
is,  iiowever,  tailored  to  operate  in  a closed  loop  environment  and 
could  possibly  be  improved  in  detail;  furtiier  experimental  resolution 
of  tlie  pliysiology  of  visual  rate  detection  will  undoubtedly  be  required 
if  a higher-fidelity  computer  model  for  the  process  is  to  be  developed. 

At  this  point  we  wish  to  consider  the  character  of  the  dynamics 
of  the  nonlinear  delay  as  a function  of  controlled  element  dynamics  or 
system  input  intensity  and  bandwidth.  This,  however,  is  to  be  done  witliin 
the  framework  of  a representative  configuration  for  the  pilot-aircraft 
system  model.  This  will  require  tiiat  we  jump  ahead  somewhat  in  the 
presentation  since  no  detailed  description  of  a suitable  pilot  model  has 
yet  been  made.  Figure  6 presents  such  a model  together  with  reasonable 
parametric  values  for  its  use.  A more  detailed  description  of  this  model 
will  be  made  in  the  next  Article. 

For  present  purposes  it  is  sufficient  to  consider  the  pilot  model 
of  figure  6 as  though  it  were  equivalent  to  the  Kleinman  model  previously 
discussed  and  shown  in  figure  2 for  the  single  loop,  visual  tracking  task. 
In  fact,  the  two  models  are  very  similar.  The  primary  difference,  other 
than  the  presence  of  nonlinearities,  is  in  the  use  of  a switch  to  select 
either  rate  or  positional  control  - - but  not  both  simultaneously  - - in 
the  model  of  figure  6.  The  parametric  values  given  in  figure  6 are 
applicable  only  to  two  controlled  elements  as  follows: 

1.  ■--//.  9 / 

2.  >^  = //.9/s(s-2) 


This  model  for  pilot-vehicle  system  dynamics  will  be  discussed  in 
the  next  Article.  It  will  be  concluded  there  that  it  is  a reasonable 
model  for  the  identical  experimental  configurations  documented  in  ref- 
erence 4 using  human  controllers. 

The  p i lot-veliicle  model  was  simulated  on  a CDC  6600  digital  com- 
puter and  allowed  to  operate  for  controlled  time  periods  during  which 
the.  describing  function  for  the  nonlinear  time  delay  was  measured.  This 
was  done  using  the  ratio  of  Fourier  coefficients  estimated  at  each  ot  the 
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il  i sc  rt  LI-’  iiipul  1 ri.'<|iii  nc  ics  Ici'  the  J<‘Iav'a  input,  and  responst.'.  Tiie 
Font  i'.T  coi*t  : ii- lent  s wi  ia.  cstira.ii  i.-d  iisinj;  Liie  computer  program  doc- 
umtiuod  ill  Appi.-iidi.<  b . it  is  iioti-d  in  Appendix  B that  the  low  frequency 
n’easun-ment s of  describing  tHaction  amplitude  and  phase  angle  are  un- 
re’i  i.ib  lo . in  gt-iu-ral,  and  tli.it  the  overall  measurcraeiit  fidelity  is  affected 
by  thi-  mi-asun-ment  time  aiul  the  sample  interval.  The  latter  were  selected 
.IS  d tO  seconds  (as  in  tlio  rcier<-nce  4 experiments)  and  0.025  second.s, 
respect  ive  Iv  , based  on  ptior  imu  1 at  ion  studies  which  established  their 
v.iliditv  for  providing  uribiasi-d  est  inuitcfi  of  the  describing  function 
amplitude  and  piiase  angle. 

Measured  describing  function  are  shown  in  figure  7 for 

two  controlled  elements,  for  three  levels  of  command  input,  and  for  con- 
stant input  bandwidth.  Note  that  the  amplitude  1 Vdl ' should  equal 
unitv  at  all  measurement  frequencies;  accordingly,  the  three  lowest  fre- 
quency data  pc'ints  of  figure  7 should  be  disregarded  as  unreliable  for 
the  eases  ts)  = Z/.9/S*  . The  phase  angle  contributions  for  two 
linear  delays  of  0.16  and  0.08  seconds  are  shown  for  comparison.  For 
n.s/s?-  it  appears  that  a linear  delay  of  0.16  .seconds  provides 
.111  e.xcelleat  fit  to  the  nonlinear  delay's  describing  function  at  fre- 
quencies greater  than  about  1.0  rad/sec.  Similarly,  the  0.08  second  de- 
lay provides  a good  match  with  the  phase  data  for  ~ • 

If  tlie  suspect  three  lowest  frequency  data  points  are  disreg.arded  then 
the  remaining  data  indicate  a tendency,  for  the  development  of  lagging, 
low-frequency  phase,  as  postulated,  for  Doth  controlled  elements.  It  is 
therefore  plausible  that  either  a nonlinear  delay  or  another  essential 
nonlinearity  having  similar  closed-loop  dynamic  effects  could  be  respon- 
sible for  the  empirical  variations  with  tontrollod  element  of  equivalent 
time  delay,  phase  or  gain  margin  and  cross-over  frequency  as  documented 
in  reference  4.  A unified  explanation  for  these  measured  variations  has 
never  been  offered.  No  consistent  effect  of  input  amplitude  is  discern- 
ible for  the  tsa  = //.  9/s^  data  cf  figure  7. 

Figure  8 ilL-jstrates  the  sensitivity  of  Yta.  to  input  bandwidth 

oa/  . For  these  data  the-  rms  input  amplitude  is  constant  (,G^^~O.S 
inches  of  displayed  error)  and  the  controlled  element  is  VJ.  = //.S/S*". 

The  case  oii  = 4.0  rad/sec  corresponds  to  a condition  of  regressed  cross- 
over frequency  (ref erence  4).  For  co^'<  4.0  these  data  suggest  that 

increa.sing  input  bandwidth  creates  an  in-  rease  in  liighcr  frequency  phase 
angles.  Tliere  is  no  clear  effect  of  on  low  frequency  phase  lag  when 

to,'  < 4.0.  For  the  regressed  ea.se  (tOf  = 4.0  rad/sec)  it  can  be  seen  that 
significant  phase  angle  reductions  occur  at  all  measurement  frequencies 
other  than  the  suspt-i:t  lowest  frequency  points.  These  re.sults  are  merely 
the  manifestation  of  the  general  shift  to  liigher  frequencies  of  the  dom- 
inant spectral  components  of  error  rate  wFien  the  input  bandwidth  is  in- 
crea.sed.  The  degree  to  whicii  thi.s  occurs  is,  in  general,  a function  of 
tlie  controlled  element  dynamics  and  the  loop  gain.s. 
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Ah  an  aside,  it  is  interesting  to  .s[)een  1 a t e about  tin  [diysioal 
nature  of  the  cOg.  regression  phenomenon  in  view  -ai  tin-  sensitivity  ol 
Yoi.  to  changes  in  input  bandwiJtii.  the  piu-nomi-mni  has  been 

attributed  to  gross,  self-adaptive  changes  in  tiie  huri an  operator's  con- 
trol technique  for  tlie  purpose  of  minimizi'-.g  the  varic  ue  of  system 
error  (reference  4).  Here,  we  see  tiial  any  techniqui  . hange  due  to  in- 
put bandwidtli  cb.anges  may  only  be  apparent;  itu  measuied  clianges  in 
system  dynamics  may  result  from  nonlinear  pheni>niena  rattier  than  from  a 
true  adiiptive  control  change,  conscious  or  unc  onsc  i c,us . 

It  is,  at  this  stage,  impossible  to  compare  t best,  trends  witii  the 
phase  lag  data  measured  in  the  reference  A erper  imer.  t s . We  have  no 
guarantee  that  the.  pilot  model  shown  in  figure  6 is  satistacLory  in  struc- 
ture or  parameterization  as  an  explanation  for  these  experimental  data. 

The  point  of  this  presentation  has  been  merely  to  establish  that  tlie  con- 
tribution of  tile  nonlinear  delay  to  system  dynamics  is  a function  of  con- 
trolled element  dynamics  and  input  charai' ter i st ies . It  should  be  clear 
tiiat  it  is  tlie  spectral  shape  of  the  error  rate  that  is  important  to 
the  determination  of  the  nonlinear  delay's  response.  Consequently,  the 
describing  function  jiaiwill  also  be  a very  strong  function  of  the 
pilot  model  gains  and  K,  (especially  Ky  ) since  these  affect  the 
qualitative  nature  of  the  closed  loop  system  response.  It  is  also 
apparent  from  the  data  of  figures  7 and  8 that  the  nonlinear  delay 
could,  in  the  region  of  closed  loop  crossover,  be  replaced  with  a 
linear  delay  and  a remnant.  These  would  varv  with  input  and  controlled 
element  exactly  as  suggested  by  the  "precision”  pilot  model  summarized 
in  reference  4. 


D.  CANDIDATE  MODELS  FOR  PILOT  DYN/vEUCS 

There  are  two  fundamental  differences  between  the  character  of 
the  pilot  models  proposed  here  and  that  of  tVie  state-uf-tiie-art  models 
(i.e.  servo  or  optimal  control  models).  Fir.st,  the  proposed  models 
are  essentially  nonlinear  for  reasons  that  liave  already  been  discussed. 
Second,  they  are  multiple  loop;  their  properties  can  only  be  understood 
within  a context  provided  by  multiple  loop  analysis  methods.  Tliere  is 
a correlation  between  the  multiple  loop  model  param.eters  and  those  of 
thc'  .servo  or  Kleinman  models;  this  will  be  established  in  a following 
article . 


All  modeling  discussions  in  this  section  are  directed  toward  the 
task  of  manual  control  in  fixed-base  tracking  with  a -visual  display  of 
system  error  and  with  a single  control.  The  multiple  loop  pilot  model 
structure  is.  however,  hypothesized  to  permit  extension  to  more  com- 
plicated control  ta.sks. 
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Thure  are  various  physLeal  sensor  mechanisms  within  the  human  body 
whicli  provide  environmental  stimuli  to  the  centra]  nervous  system.  A 
tundamental  assumption  of  this  work  is  that  eacli  of  tliese  serves  as 
a potential  point  for  the  feedback  of  stimulus  information  to  the  human 
cont  roller . 

It  is  further  assumed  that  no  equalization  is  permitted  of  any 

feedback  variable.  That  is,  no  lead  or  lag  may  be  generated  within  any 

signal  path.  Instead,  if  th.e  servo  description  of  the  human  pilot 
requires  that  lead  be  generated  for  the  control  of  a particular  controlled 

element,  then  the  multiple  loop  model  will  require  the  feedback  of  error 

rate  through  the  visual  rate  sensor.  The  inanner  by  which  the  multiple 
loop  model  provides  lag  equalization  will  be  discussed  in  a subsequent 
art  ic  I e . 

The  general  structure  of  the  hypothesized  pilot-vehicle  model  is 
sliown  in  figure  9.  This  is  a generalization  of  figure  6.  The  , 

model  contains  a feedback  of  position  J and  of  position  velocity  * - • 

A command  input  a;  (t)  is  used  with  system  error  and  system  error 

rate  displayed  to  the  pilot.  The  generation  of  error  rate  requires 

the  creation  of  a rate  command  such  that  X;  - (this  is  to  avoid 

liaving  to  differentiate  )■  A rate  washout  is  used  for  reasons 

that  will  be  discussed  later.  A threshold  nonlinearity  is  used  at 
the  point  of  position  error  detection  to  simulate  a visual  threshold  of 
perception  or  one  due  to  a pilot's  indifference  to  small  errors.  The 
loop  gains  on  rate  and  position  Ky  are  assumed  to  be  nonlinear, 

single-valued  functions  of  the  delayed  rate  Xd  and  the  perceived  error 
i/T  . The  block  labeled  ”S”  is  intended  to  represent  either  a summing 
junction  (i.e.  fii-x,-*  ) or  a nonlinear  switch,  as  in  figure  6 (i.e. 

]S=  ,2s.  or  /ij  ). 

The  model  used  for  neuromuscular  system  dynamics  is  the  same 

as  that  shown  on  figure  6 and  derives  from  reference  10.  Several 
points  are  worth  noting  about  this  model  and  its  implications. 

The  experiments  documented  in  reference  10  were  of  the  highest 
possible  quality  within  the  present  state-of-the-art;  they  permitted 
a direct  measurement  of  neuromuscular  dynamics.  The  authors  of  that 
report  indicated  how  neuromuscular  dvnamics  are  affected  by  control 
feel  characteristics;  the  parameterization  of  shown  in  figure  6 

is  believed  to  be  reasonable  for  tracking  tasks  of  the  sort  discussed 
in  reference  4.  The  measured  time  delay  associated  with  CS) shoul d 
bo  compared  with  the  human  operator  delay  given  in  the  "Precision 
Pilot  Model”  of  reference  4.  It  can  be  seen  that  they  are  almost 
exactly  the  same.  That  is,  the  Precision  Pilot  Model  delay  (X,  - .09) 
of  reference  4 should,  according  to  reference  10,  be  attributed 
entirely  to  the  neuromuscular  system.  It  was  this  comparison  that  led 
to  the  omission  of  a time  delay  in  the  position  control  portions  of 
figures  6 and  9. 
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It  wj,-.  r-illu-r  autiiorital  ively  staled  in  reference  4 that  the 
! .!>;>',in>'.  lew  lrei|iK'ni  v phase  in  measurements  of  the  human  pilot  descri- 
bing; t uni  t ion  i > attributable  to  the  neuromuscular  system;  a model  for 
musi  1 1-  ^.pindli'  dvnamics  was  derived  (discussed  in  reference  11)  and 
ei’ered  in  later  work  as  a tlieoretical  basis  for  this  conclusion.  However, 
the  dire  t niea  .iiieTent  01  neuromuscular  system  dynamics  as  documented  in 
tiien-nce  I'd  api>ears  to  contradict  this  conclusion;  no  evidence  is  shown 
to  -iippot  t the  issigninent  of  low  frequency  phase  lags  to  the  neuromuscular 
ss'.iem.  Ihe  authors  of  reference  10,  in  fact,  attributed  the  phen- 
omenon t.  "ntinal  and  central  equalization"!  it  is  hoped  that  the  in- 
trodu'tion  in  tliis  report  oi  a multiple  loop  pilot  model  structure  and 
non  1 i near  i t i es  in  the  rate  sensor  will  eventually  resolve  the  matter. 

•As  .in  aside,  it  is  wortliwriile  to  note  chat  rather  unexpected  closed 
loop  oscillations  were  observed  by  Teper  in  his  fixed-base  hover 
simulation  of  V'/STOL  control  (reference  12).  These  were  lightly 
damped  control  oscillations  at  frequencies  from  A to  6 radians/second. 

Teper  attributed  these  to  the  neuromusuclar  system  and  accounted  for 
tliem  in  his  servo  model  characterization  and  measurements.  No 
explanation  for  their  unusually  low  frequency  was  offered,  however, 
nor  is  one  apparent  vis-a-vis  the  servo  or  optimal  control  models 
or  from  the  neuromuscular  system  dynamics  of  reference  10.  It  is 
plausible  to  expect  that  a closed  loop  mode  of  that  sort  could  originate 
as  a multiple  loop  effect  - - possibly  one  involving  the  nonlinear 
delay . 
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The  pilot  model,  as  originally  proposed,  did  not  employ  a switching 
function  between  the  two  feedback  paths.  Instead,  the  signals  and 

/iy  were  summed  to  represent  coordinated  control  activity.  It  was 
determined  by  trial,  however,  that  large  thresholds  in  the  rate 

and  position  loops  tended  to  create  lagging  low  frequency  phase  angles 
in  the  measured  pilot  model  describing  function.  There  was  no  compelling 
physical  justification  for  large  dual  thresholds;  however,  the  char- 
acter of  their  effect  was  such  as  to  almost  always  yield  either  rate  or 
positional  control,  but  not  both.  This  suggested  that  a time-sharing 
model  for  pilot  dynamics  would  be  a physically  reasonable  alternative 
and  one  consistent  with  the  recent  work  of  Onstott  for  multiple  axis 
tracking  (reference  15).  For  that  reason,  the  switching  function  was 
devised  and  evaluated  as  a candidate  nonlinearity. 

The  system  input  ijl(t)  was  chosen  to  match  those  of  reference  4. 

These  were  formed  as  the  sum  of  ten  non-synchronous  sine  waves  with 
frequencies  and  component  amplitudes  (suitably  scaled)  chosen  to  replicate 
tiic  experimental  situation  of  reference  4;  these  are  listed  in  Table  1. 

The  input  spectrum  is  illustrated  on  figure  6. 

An  explanation  for  the  incorporation  of  rate  washout  in  the  pilot 
model  is  difficult  to  make  at  this  point.  In  Article  K of  this  section. 
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however,  it  will  be  sliown  Lhot  the  r;ite  eommand  Xlit'ilO  is  suffielent 
it  rlie  multiple  loop  mode)  is  to  aeeount  for  the  lag  equalization  re- 
quired by  the  servo  model  for  a pure  gain  controlled  element.  In  general 
X,(t)  is  nonzero  when  a command  input  exists;  however,  X;(t)=0  can  be 
achieved  in  a practical  sense  when  the  command  input  bandwidth  is  low 
frequency  provided  a low  frequency  washout  is  inserted  in  the  rate  sensor 
location.  This  was  the  essential  reason  for  its  introduction.  Such  a 
filter  is  physically  reasonable  since  it  is  unlikely  that  a human  pilot 
is  responsive  to  very  low  frequency  rate  errors  - - he  would  merely  try 
to  null  the  position  error.  It  is  also  possible  that  rate  washout 
dynamics  can  contribute  to  explaining  the  origins  of  the  low  1 requency 
phase  lags. 

rhe  controller  gains  and  /dy  were  chosen  to  be  nonl  inear  func- 
tions of  amplitude  in  an  attempt  to  duplicate  certain  pilit  beliavior 
that  has  been  identified  in  the  literature  as  "adaptive,"  Specifically, 
it  was  hoped  that  one  set  of  pilot  model  parameters  could  be  deter- 
mined that  would  permit  control  of  several  controlled  elements  witliout 
further  adjustment. 

E.  REQUIREMENTS  FOR  MODEL  VALIDATION 

The  pilot  model  form  proposed  in  the  last  article  must,  in  some 
manner,  be  validated  as  an  adequate  theory  for  rationalizing  part  or  all 
of  the  available  data  base  for  human  pilot  dynamics.  A twofold  problem 
must  be  addressed  by  the  validation  program.  First,  the  proposed 
model  is  incomplete  in  detail;  only  it.s  structure  is  defined  and  even 
that  is  variable  according  to  whether  or  not  the  model  is  to  incorporate 
a switch  between  the  control  of  error  and  error  rate.  Consequently  the 
validation  effort  must  resolve  the  form  desired  of  each  nonlinear  element 
to  be  included  within  the  model.  Second,  the  model's  parameters  must 
be  quantified  to  simulate  actual  system  response  to  acceptable  levels  of 
f idelity . 

It  would  be  relatively  easy  to  select  the  elements  of  figure  9 to 
model  pilot-vehicle  system  dynamics  and  performance  for  a particular 
combination  of  input  and  controlled  element.  The  concern  here,  however, 
is  that  the  resulting  model  provide  a unified,  physically  acceptable 
theory  for  the  explanation  of  empirical  trends.  The  principal  data  base 
available  for  model  comparisons  is  provided  by  reference  4.  The 
general  requirements  to  be  imposed  on  the  pilot  model  are  that  it 
provide  stable  closed  loop  system  response,  with  time  histories  qual- 
itatively equal  to  what  one  would  expect  from  experiment,  and  yield 
describing  function  measurements  in  agreement  with  those 

summarized  in  reference  4.  Additional  requirements  are  that  the  model- 
predicted  distributions  of  control  motion,  the  control's  power  spectral 
density,  the  remnant,  and  the  correlation  coefficients  all  substantially 
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agree  with  the  reference  4 data.  Further,  it  is  desired  that  the  final 
pilot  model  require  a minimum  number  of  parametric  changes  to  account 
for  the  entire  range  of  controlled  element  and  system  input  combinations 
which  constitute  the  data  base.  That  is,  insofar  as  is  practical  and 
physically  acceptable,  the  model  should  exhibit  the  qualities  usually 
attributed  to  self-adaptation.  This  is  a self-imposed  restriction 
introduced  because  it  seems  to  be  a plausible  approach  to  rationalizing 
our  understanding  of  human  controller  dynamics.  Such  a model  would 
also  contribute  to  simplified  practical  applications  by  non-specialists 
since  it  would  be  self-adaptive  to  a large  degree. 
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F.  SPECTRAL  AN.-VLYSIS 


In  this  section  we  wish  to  develop  some  basic  signal  properties 
for  the  pilot-vehicle  model  of  figure  9.  These  will  be  used  in  the 
next  article  to  establish  comparisons  between  the  nonlinear,  multiple 
loop  model  and  the  conventional  servo  model  descriptions  of  the  human 
pilot . 


Consider  the  two  loop,  two  input,  single  controller  system  of 
figure  10.  The  signals  r\^  and  are  assumed  to  be  noise  injection 

processes  and  are  assumed  to  be  uncorrelated  with  Xi  or  . In  the 
following  analysis,  consider  the  system  signals  to  be  expressed  in 
terms  of  their  Fourier  transforms  where  appropriate.  The  total  system 
response  to  , w-  , 


where 


'JlJ 


^ 

I + Gy  Gy  Xg 


= H, 


Gm  ^6 


Other  closed  loop  signals  are; 

Vs 

a;  - a 
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Cross-spectral  density  expressions  may  be  develo()ed  as  lollows: 


= X' ‘j'co) 


= Xo  ^ *^x  ny  J 

INa  tSi  rt 


Hx  ^ ^ Is  ^ = «X  Hy  , 
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^_j^cy4xj)=  Sijui->  Sijco-)  = X<jco)X(/coj 

% 

c;c^:>  = '■'y  S 
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Tl'.ere  are  two  special  cases  of  interest  in  tlie  development  of  com- 
parisons between  the  servo  model  of  figure  1 and  the  nonlinear 
model  of  figure  9 that  may  be  derived  from  the  above  equations. 

Spec ial  Case  #1 


and  are  linearly  correlated  according  to  the  following 

rules : 


(V 


dt 


% = 


dji 

dt 


The  first  five  equations  are  then  specialized  as  follows: 


(>W, 


i. 


fiJ 

(Z)' 

(3)' 

(S/ 


Equations  6-10  are  redundant.  Observe  that  since 


■% 

s 1 1 


X-;  ^ t “ I - «x  1 1 - (j- 1 

then  the  same  grouping  of  and  Hy  occurs  in  all  five  equations; 

i . e . Mg  and  Wy  occur  only  ns  the  linear  combination 

Hy  = My  jcL> 

Therefore,  only  one  of  ec|uations  1-5  is  independent.  (It  would 
be  possible  to  generalize  this  result  to  n-inputs  and  m-controls  by 
introducing  vector  notation).  For  this  special  case. 
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Ht  = Hy  + Hx 
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where  Voc  is  an  equivalent  open  loop  describing  function 

= C^x ■>■  ^y)  Xf  “ ^ (yco; 


<r  (jto ) = (.Gx + <Sy  ) ^/w,  ye  ^ j f ( r>x  , ) 


“ CGx;oj  + 


^ (Jwi=  iGja,-.Gy)G^  = 

^y.-ye 

it  is  understood  that  S/^^^(ju>)  is  a describing  function  in  the  above 
analysis.  The  sequence  of  block  diagram  reductions  by  which  the  general 
system  of  figure  10  is  specialized  for  this  case  is  shown  in  figure  11. 


Special  Case  112 

The  X-channel  command  is  identically  zero;  i.e.  X;(t)=0  . 
equation  (6)  and  (7)  become 

f„.,  - 

Ye  a;ai 


Then 


= (I- Hy)  ^q-w' 

Ji-Je 

Equations  (8),  (9)  and  (10)  are  redundant.  Then 


- 1 H y ^ 

<f  ^ l-Hy  I G y G^  >^  ■*■  iSjf  - Gy  Gm  Xf 

Gry  Cm 

/ + Gy 
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However,  this  is  just  the  closed  loop  describing  function 


_ 

I + X£  ^y/ye 


The  notation  ( 5e  ir><Jicates  that  the  describing  function  is 

the  equation  resulting  from  closed  loop  control  of  x with  <P  . The 
reduction  of  this  case  to  an  equivalent  single  loop  control  system  is 
demonstrated  in  figure  12.  It  is  noted  that  equation  13  is  true 
regardless  of  any  possible  correlation  between  x and  y;  it  only  le- 
quires  . Equations  12  and  13  are  directly  applicable  to 

the  pilot-vehicle  system  model  of  figure  9 for  the  tv;o  special 
cases . 
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G.  SERVO  V.  NONLINEAR  PILOT  MODEL  COMPARISONS 


The  most  thoroughly  researched  and  documented  dynamic  description 
of  the  human  pilot,  embodied  in  the  "precision  pilot  model"  of 
reference  4,  is  illustrated  in  figure  1.  A set  of  "adjustment 
rules"  for  selecting  the  model  parameters  given  the  input  and  controlled 
element  is  an  integral  part  of  the  model.  This  empirical  model  is  based 
on  the  notion  that  pilot-vehicle  system  dynamics  are  single  loop  in 
structural  form  witli  lead  or  lag  compensation  in  the  pilot  model  accor- 
ding to  the  character  of  the  controlled  element  dynamics.  The  servo 
description  of  pilot  dynamics  can  be  measured  as  the  ratio  of  cross- 
spectral  densities;  viz. 


da 


We  wish  to  make  heuristic  comparisons  between  the  servo  model 
and  the  nonlinear,  multiple  loop  model  proposed  in  this  report  and  shown 
in  figure  9.  This  Article  will  address  the  plausibility  of  the  non- 
linear model  as  an  alternative  explanation  for  the  experimental  data 
base  of  reference  4 and  offer  suggestions  for  why  the  servo  model 
parameters  vary  with  the  experimental  configuration  in  the  manner 
codified  in  the  "adjustment  rules."  At  this  point,  the  detailed 
structure  of  the  nonlinear  model  has  not  been  established  nor  are  its 
nonlinearities  known  in  sufficient  detail  to  support  an  in-depth  analysis. 
Consequent Iv.  describing  function  representations  of  the  nonlinear  model 
will  be.  used  for  analytical  comparisons. 


An  underlying  assumption  of  the  servo  model  is  that  the  visual 
display  of  closed  loop  error  constitutes  a scalar  input  of  information 
to  the  human  pilot.  The  nonlinear  model  is  based  on  the  notion 
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that  information  is  perceived  by  the  human  as  a vector  quantity;  in 
particular  a compensatory,  visual  display  is  assunieti  to  prt>vide 
both  error  and  error  rate  information  through  pliysio.allv  distinct 
sensor  paths.  The  direct  sensation  of  visual  rate  by  tlie  multiple 
loop  model  and  lead  equalization  by  the  precision  pilot  model  are 
strictly  equivalent  only  under  very  specialized  conditions.  In 
particular,  there  must  be  no  significant  nonlinearity  o>"  dynamic 
element  that  is  peculiar  to  only  one  of  the  two  information  paths. 

Also,  the  transmission  time  delays  must  be  equal  for  both  paths. 

The  literature  of  human  dynamics,  by  implication,  has  historically 
treated  rate  feedback  and  lead  generation  as  equivalent  processe.s. 

It  was  Indicated  earlier  in  this  report  that  the  servo  and  optimal 
control  models  are  equivalent.  Here  it  should  be  noted  that  the 
Kleinman  model  structure  (figure  2)  is  very  similar  to  that  of  t'ne 
nonlinear  model  (figure  9).  They  differ  principally  in  that  tlie 
same  time  delay  is  assumed  for  both  rate  and  position  information  in 
the  Kleinman  model,  whereas  the  rate  delay  Is  functionally  dependent 
upon  the  nonlinearity  and  the  error  rate  amplitude  spectrum  in  the 
nonlinear  model.  Also  the  Kleinman  model  treats  the  neuromuscular 
system  dynamics  in  a very  expedient,  non-physical  manner  that  may, 
for  certain  controlled  element  dynamics,  be  a bit  too  crude;  this, 
however,  is  not  a matter  of  first-order  importance.  Here  we  merely 
wish  to  indicate  the  similarity  between  the  Kleinman  and  the  nonlinear 
models  and  to  note  that  comparisons  drawn  in  this  Section  between 
the  servo  and  nonlinear  models  apply  equally  well  to  the  Kleinman 
model . 

The  closed  loop  system  of  figure  10  may  be  considered  to  be  a 
random  input  describing  function  representation  of  the  proposed 
nonlinear  pilot  model  of  figure  9.  The  describing  function  , 
for  example,  represents  the  linear  portion  of  the  response  to  closed 
loop  errors  in  rate  of  the  visual  and  central  processor  dynamics. 

The  transfer  function  is  identical  to  the  controlled  element  transfer 
function  Vets)  of  figure  9. 

It  was  shown  in  the  last  article  that  the  closed  loop  system  of 
figure  10  reduces  to  the  corresponding  single  loop  form  of  figure  11 
for  the  special  case  where  and  are  the  time  derivatives  of  y; 
and  y , respectively  (Special  Case  Itl)  . Comparison  of  figures  (1) 
and  (U)  indicates  that  when  the  signals  X and  are  linearly  corre- 
lated according  to  the  assumptions  of  the  nonlinear  pilot  model,  the 
relation  between  the  human  pilot  describing  function  from  the  servo 
theory,  and  that  from  the  nonlinear  theory  is 

Vp  tjwj)  = ( jeo  Gy  ) 

However,  the  liescriblng  functions  Gy  <md  Gy  are  unknown  (since  neither 
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the  non!  inearit ies  nor  the  detailed  .structure  of  the  multiple  loop 
model  is  known) . By  comparison  of  figures  9 and  10,  it  seems 
reasonable  to  assume  that 
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where,  for  convenience  in  manipulation,  ju)  has  been  replaced  by  the 
complex  variable  s;  and  To  are  the  statistical  ave’-ages 

of  K"*  , /fy  and  "C  , respectively.  The  visual  threshold  describing  ^ 

function  has  been  incorporated  in  . Witli  a first  apjirox  ima  t ion  1 or  € 
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The  zeros  of  SG, -» are  roots  of  F + 1 = 0,  where,  by  definition 
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The  roots  of  F + 1 = 0 vary  with  ® in  the  manner  depicted  in  the 


following  root  locus  sketch: 


X-%- 


(i) 


A plausible  form  for  sG^+^v  > nominal  values  of  Ky^  and  , 

is  then  seen  to  be  / i \ 

I 1 

SG, 

where  the  first  order  Pade^  approximat ion  has  been  Replaced  by  the  trans- 
form for  a constant  delay  (this  assumes  that  Zg  )•  From  reference  10 
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Equation  14  is  nearly  the  same  form  as  the  Precision  Pilot  Model, 
(references  4 and  10),  repeated  here  for  the  reader's  convenience: 
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Note  that  the  terms  (tJj‘*>  + I)  and  ),  constituting  a lag-lead 

pair  in  the  multiple  loop  model,  appear  to  be  compatible  with  the 
low  frequency  factors  I ) and  (T^'Jco+i  ) from  the  Precision 

Pilot  Model.  Equation  14  contains  a lead  term  + I ) as  required 

by  the  servo  theory  for  pilot  equalization.  However,  it  contains  no 
lag  term  equivalent  to  (Tjjco+I  ) of  equation  15. 


The  servo  theory,  embodied  in  the  Precision  Pilot  Model  (equation  15) 
and  the  "adjustment  rules,"  requires  that  the  analyst  select  the  pilot 
model  parameters  according  to  (primarily)  the  controlled  element 
dynamics  )^(s)  . Generally,  either  T,.  or  Ti  is  nearly  zero  according  to 
whether  lag  or  lead  equalization  is  required  to  satisfy  the  closed 
loop  system  dynamic  requirements.  Later,  an  explanation  will  be  offered 
of  how  the  nonlinear  model  can  produce  lag  equalization.  Now  we  wish 
to  discuss  the  multiple  loop  model,  equation  14,  vis-a-vis  the  servo 
model,  equation  15.  Note,  however,  that  both  models  are  "servomechanism" 
descriptions  (e.g.  compare  the  structure  of  figures  1 and  6).  The 
"servo  model,"  however,  has  become  synonymous  in  the  literature  with 
the  Precision  Pilot  Model  (equation  15);  the  generic  term  is  used  here 
in  that  parochial  sense.  Furthermore,  we  wish  to  establish  that  the 
nonlinear,  multiple  loop  theory  need  not  be  rooted  in  the  framework 
of  assumptions  that  force  the  human  pilot  model  to  be  analogous  to  a 
linear,  t ime-invar iant  servomechanism  as  in  the  "servo"  theory.' 

Comparison  of  equations  14  and  15  indicates  several  important 
points: 

1.  The  visual  and  indifference  threshold  • from  equation  15 

is  not  explicitly  present  in  equation  14.  However,  if  the  full  effects 
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of  Che  nonlinear  time  delay  were  considered  then  it  is  reasonable 
to  expect  that,  in  accordance  with  previous  discussions,  an  apparent 
threshold  would  exist  due  to  the  rate  sensor.  Therefore,  measure- 
ments of  >p  from  experimental  tracking  data  would  contain  a 

remnant  effect  that  could  reasonably  be  attributed  to  an  error  thres- 
hold due  to  the  linear  correlation  of  error  and  error  rate. 

2.  The  time  delay  1:0  in  equation  14  originates  in  the  hypoth- 

esized rate  sensor  nonlinearity.  It  is  equivalent  to  the  delay  z in 
equation  15  when  the  neuromuscular  delay  is  included.  The  mag- 

nitude of  the  delay  is,  however,  dependent  in  some  as  yet  unknown 
fashion  upon  the  level  of  the  closed  loop  error  rate  signal.  This,  in 
turn,  will  be  a function  of  the  pilot  model  gains  (notably  ),  the 
controlled  element  dynamics,  , and  Che  spectral  properties  of  the 

system  input.  Therefore  it  is  plausible  that  a nonlinear  delay,  prop- 
erly parameterized,  could  rationalize  the  experimental  variations  of  "C 
(from  equation  15)  as  they  are  known  to  exist  and  are  documented  in 
reference  4. 

3.  Equation  14  suggests  that  the  dominant  effects  of  the 

nonlinear  time  delay  on  the  pilot  model  will  occur  serially  with  the 
term  6-*  . This  could  account,  in  part,  for  the  lagging  low  fre- 

quency phase  angles  measured  and  documented  in  reference  4 and  modeled 
in  the  Precision  Pilot  Model  by  the  factor 

Tk  jto  I 
^ I 

in  equation  15.  The  nonlinear  model  suggests,  however,  that  the 
lagging  low  frequency  phase  will  result  from  the  combination  of  the  non- 
linear delay  with  the  washout  dynamics.  The  low  frequency  lead  time 
constant  is  dependent  upon  the  Washout  time  constant  , the  error 

rate  signal  amplitude  level  (and  hence  To  ) , and  the  relative  gains 
for  error  and  error  rate  control  / K^o  • 

4.  The  low  frequency  lag-lead  pair  in  the  Precision  Pilot  Model 
discovered  in  the  reference  4 experimental  program  was  attributed 

to  neuromuscular  system  dynamics  in  that  report.  In  reference  10 
the  effect  was  conclusively  shown  not  to  result  from  direct  neuro- 
muscular dynamics,  and  the  terras  were  attributed  to  "central  processes." 
Here  the  terms 

joo  a-  I 

in  equation  14  are  seen  to  be  the  result  of  rate  sensor  dynamics 
(modeled  as  a rate  washout  because  no  information  is  known  to  exist 
to  permit  further  refinement)  together  with  a multiple  loop  model 
structure  which  treats  error  and  error  rate  as  distinct  components  of 
an  information  input  vector. 
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5.  Any  wholesale  attempt  to  interpret  and  rationalize  the 
behavior  of  the  Precision  Pilot  Model  parameters  shown  in  equation  15 
from  the  basis  of  a conventional  single  loop  servo  theory  description 
of  the  human  pilot  las  in  figure  1)  would  be  extremely  confusing  if 
the  nonlinear  model  (figure  9)  is,  in  fact,  more  physically 
appropriate.  To  illustrate,  the  nonlinear  model,  embodied  in 
equation  14,  indicates  that  the  time  constants  Xq  , Ti.  , and  Tw' 
are  all  interrelated  in  an  orderly  way.  There  is  no  physical  model 
for  this  behavior  in  the  single  loop  servo  model. 

6.  The  parameters  t^p  , To  , T^.  and  xj  of  equation  14  are  all 
input-dependent  to  the  extent  that  this  affects  the  level  of  error 
rate  and,  hence,  the  nonlinear  delay's  response.  Controlled  elements 
which  tend  to  produce  highly  oscillatory  closed  loop  responses  can 
therefore  be  expected  to  demonstrate  the  most  sensitivity  of  these 
parameters  to  input  level.  If  the  nonlinear  model  is  a suitable 
description  of  the  human  controller's  actual  behavior,  then  the  comment 
applies  to  the  parameters  Kp  , x , 11.  and  Tk  of  equation  15. 

7.  An  experimental  program  to  measure  cannot,  in  general, 

distinguish  which  of  the  two  candidate  pilot  models  (the  single  loop 
model  or  the  nonlinear  model)  is  correct.  Both  describing  functions 
are  given  by  the  ratio  of  cross-spectral  densities: 

single,  lotsp  n'lulliple.  leap 

The  nonlinear  model  offers  a physical  model  for  explaining  exper- 
imental phenomena  that  are  treated  empirically  within  the  single  loop 
servo  theory.  This  in  turn  may  be  of  benefit  for  establishing  the 
validity  of  the  nonlinear  model. 

But  what  of  the  Precision  Pilot  Model's  requirement  for  lag 
equalization  (1^Jco-r/  )?  Consider  tlie  following: 

1.  The  lag  equalization  shown  in  equation  15  was  determined 

to  apply  when  the  controlled  element  dynamics  were  essentially 
a pure  gain  at  low  frequencies,  i . e . C s) = . 

2.  A pure  gain  controlled  clement  produces  no  attenuation  of 
closed  loop  modes  present  in  the  control  stick  response. 

3.  The  lag  equalization  was  determined  to  exist  by  Elkind, 
reference  14,  for  low-frequency,  low-amplitude  command  inputs;  his 
data  do  not  confirm  its  presence  for  his  more  unconventional,  high- 
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frequency  inputs.  The  reference  4 experiments  confirmed  Elkind's 
results  with  low-bandwidth  inputs. 

The  postulated  nonlinear  rate  sensing  leads  one  to  suspect  that 
for  controlled  element  dynamics  similar  to  those  of  a pure  gain,  with 
low  bandwidth  inputs,  the  error  rate  signal  perceived  by  the  human 
operator  may  be  dominated  by  the  response  rate  of  the  controlled 
element;  that  is,  the  rate  command  may  be  essentially  zero.  If  this 
is  assumed  then  the  closed  loop  system  of  figure  10  reduces  to  the 
special  case  #2  discussed  in  the  last  article  and  shown  in  figure  12. 
For  this  case,  the  multiple  loop  pilot  model,  if  valid,  will  reduce 
to  the  corresponding  form  given  by  the  Precision  Pilot  Model.  That 
is,  from  equation  13  with  Xj  = jto  , 


yp(jca)  = 


(ts) 


where  <Ju>i  should  be  compatible  with  equation  15.  Once  again, 
the  describing  functions  Gj,  ijco)  and  are  unknown.  For  the 
purpose  of  demonstrating  the  suitability  of  the  nonlinear  multiple 
loop  model  as  an  alternative  to  the  Precision  Pilot  Model,  and  for 
consistency  with  the  rationale  for  equation  14,  assume 

^xo  ^ s e 


Gy  = Ky^ 

where  for  notational  simplicity,  yxi  has  been  replaced  by  the  complex 
variable  s;  and  "C„  represent  average  values,  in  some  un- 

defined sense,  of  K„  , Ky  and  "C  respectively.  Use  the  previous 
expression  for  Gf^<i)  and  the  first-order  Pade  approximation  for  the 
time  delay  terms.  Define 


F * S <Sx  >c  = 


s'"  (■ 


S -t 


'Xi*') 


S -r  ij  ( 


' S -*■  I, 


Roots  of  F+1  = 0 are  poles  of  . They  vary  as  a function  of 

in  the  manner  shown  on  the  following  root  locus 
sketch.  The  particular  pole-zero  configuration  shovm  is  believed  to 
be  consistent  with  the  known  data  base  for  neuromuscular  system 
dynamics  (reference  10)  and  with  the  washout  dynamics  hypothesized  in 
this  report. 
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To  a first  approximation,  = To  ■*•  "Oim  • cancellation  of  time 

delay  terms  appearing  in  the  final  expression  for  Ij'oj)  will  not 
be  precise.  However,  the  phase  contribution  to  due  to  the 

time  delay-derived  term 
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can  be  approximated  by  6 
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Equation  17  is  an  approximation  to  the  nonlinear,  multiple  loop  pilot 
model  provided  that  the  rate  and  position  loop  nonlinear  effects  are 
adequately  represented  by  the  forms  assumed  for  the  describing  func- 
tions G*  and  Gy  . However,  equation  17  is  a valid  representation  for 
human  dynamic  response  if  and  only  if  it  is  completely  consistent  with 
the  Precision  Pilot  Model  (equation  15)  which,  of  course,  is  merely 
an  analytical  fit  to  the  available  manual  tracking  data  base. 


Equation  17  may  be  directly  compared  with  the  Precision  Pilot 
Model.  No  low-frequency  lead  equalization  term  (!,_£+])  appears  in 
equation  17;  this  term,  however,  is  not  necessarily  present  in  the 
Precision  Pilot  Model  for  pure  gain  controlled  elements  with  low- 
frequency  command  inputs.  The  low-frequency  ratio 
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is  seen  to  be  lend- I ag  in  iorm  (i.e.,1^  ^ ) instead  of  lag-lead 
as  prescribed  by  t!ie  Precision  Pilot  Model  of  equation  15.  This  is 
not  regarded  as  a serious  issue  here  since  the  data  base  for  pure  gain 
controlled  elements  (chiefly  reference  4 and  14)  does  not  permit 
high  quality  resolution  of  the  low  frequency  phase  lag.  The  lag-lead 
explanation  for  this  phase  lag  in  the  Precision  Pilot  Model  is  empir- 
ical and  based  on  the  assumption  of  a single  loop  pilot  model  struc- 
ture with  constant  time  delay.  The  multiple  loop  theory  attributes 
the  phase  lag  to  two  sources:  the  washout  dynamics  coupled  with  other 

system  dynamics  and  the  nonlinear  delay,  directly.  Equation  17  does 
not  contain  a first-order  neuromuscular  system  lag.  This,  also,  is 
not  a matter  of  concern  here  since  the  lag  is  of  little  significance 
to  closed  loop  system  dynamics  and  since  the  data  base  for  pure  gain 
controlled  elements  does  not  permit  its  resolution  with  any  accuracy 
(i.e.  it  may  not,  in  fact,  exist  for  pure  gain  controlled  elements). 
Elkind's  measurements  did  not  extend  to  the  neuromuscular  range  and 
the  reference  4 experiments  purposely  did  not  address  the  pure  gain 
controlled  element  to  any  depth. 

Equation  17  does  contain  the  first-order  lag  term  ( 7i  S + I ) 
required  by  the  Precision  Pilot  Model.  This  term,  according  to 
the  multiple  loop  theory,  originates  from  coupling  between  the  neuro- 
muscular system  time  constant  and  the  washout  time  constant  Tw  due 

to  rate  feedback!  This  is  a complete  departure  from  the  conventional 
viewpoint  regarding  its  origins  and  is  - - at  least  to  this  author  - - 
a much  more  palatable  explanation  than  the  assumption  of  premeditated 
lag  equalization  by  a single  loop  human  pilot.  The  origin  of  the  lag 
term  in  the  multiple  loop  model  may  be  seen  much  more  clearly  if  the 
neuromuscular  system  dynamics  are  neglected.  A low  frequency  approx- 
imation is  then 

= = ; ; — — ; — 

\ jUi  ^ 

where  This  is  overly  simplified,  perhaps,  but  it  clearly 

demonstrates  that  the  lagging  equalization  is  the  result  of  the  inner 
(rate)  loop  closure  of  figure  12. 

The  possibility  must  be  accepted  that  this  same  form  for  IpCy'to) 
can  apply  to  controlled  elements  other  than  pure  gains.  The  multiple 
loop  theory  suggests  that  the  applicability  of  equation  16  will 
depend  upon  the  system  input  as  much  as  upon  the  controlled  element 
dynamics  due  to  the  hypothesized  rate  sensor  nonlinearity.  Until  the 
structure  and  component  descriptions  of  figure  9 are  resolved  in 
detail,  it  will  not  always  be  possible  to  make  an  a priori  deduction  of 
the  correct  form  for  given  arbitrary  combinations  of  controlled 

elements  and  input . 
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The  simplified  analysis  above  can  be  applied  to  other  controlled 
elements  with  effect.  Assume  ; 

1.  yjcsi®  g'  ; it  is  well-known  that  control  of  such  dynamics 
is  "easy"  and  "pleasant.”  The  closed  loop  response  is  not  oscillatory. 
For  low  bandwidth  command  or  disturbance  inputs  it  is  reasonable  to 
assume  (i  .e.  no  rate  feedback).  Then 

yp<53=  Sfi*  = Ky^ 


That  is,  a low  frequency  approximation  to  ^ is  a pure  gain  - - in 
agreement  with  the  Frecision  Pilot  Model.  It  is  interesting  to  point 
out  that  when  no  command  input  exists  (*;  (tl»  = O ) then 


= 


Gm 

I ■*  iGx 


would  appear  to  apply  regardless  of  the  controlled  element.  For  tlie 
Kj  /S  controlled  element,  assuming  I , this  form  will  reduce  to: 


y 3 = K,  - - - - a pure  gain! 

I - Kk^Kc 

That  is,  this  viewpoint  suggests  that  an  inner  loop  rate  feedback  only 
serves  to  modify  the  gain  of  the  outer-loop  equivalent  controlled 
element.  Consequently,  there  is  no  rigid  requirement  on  the  level  of 
rate  control  required  to  create  a satisfactory  loop  closure. 


Ke, 

2.  's  ; this  is  known  to  be  a 

control.  Assume  the  correct  model  form  is 


"difficult"  system  to 


Vp  = S G„  + Gy  3 «y^  ( S + 

The  alternative  possibility  (for  no  rate  command  input,  at  least)  is 

y _ Gy ^ ^ 

^ I + Gx  /S  S ♦ 

Either  of  these  forms  is  plausible;  the  first,  however,  probably 
best  agrees  with  the  experimental  evidence. 


These  three  examples  suggest  tliat  change  in  controlled  element 
dynamics  from  the  form  *^Vs  to  Kc  to  requires  a progressive  increase 

in  the  level  of  rate  loop  control  to  satisfy  the  overall  closed  loop 
requirements.  It  seems  reasonable  to  expect  tliat  tiighly  unstable 
controlled  elements  will  require  additional  increments  of  rate  control. 
At  this  point  it  should  be  noted  that  the  unified  ranking  of  these 
controlled  elements  with  respect  to  their  equalization  requirements 
is  po.ssible  only  because  the  proposti  model  treats  error  and  error  rate 
as  distinct  stimuli  within  a multiple  loop  structure.  The  lag  required 
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ill  the  conventional  theory  for  ^Cs>=-  simply  doesn't  "fit"  with 

a ranking  of  controlled  elements  according  to  their  lead  equalization 
requirements. 

In  summary,  tlie  simplified  treatment  above  lias  established  tlie 
plausibility  that  all  controlled  elements  may  be  classified  according 
to  their  requirements  for  rate  feedback  "activity."  Namely,  the  l^c/s 
controlled  element  requires  no  or  minimum  rate  feedback,  Kc.  requires 
more,  and  /s*"  requires  more  yet.  Unstable  controlled  elements  may 
be  expected  to  fit  witliin  this  ranking  in  an  orderly  fashion;  e.g. 
y^ts)!  «c/cs-X)  will  probably  require  more  rate  feedback  than 
will  but  less  than  y^Ciic«c/S^-  - at  least  for  A less  than 

about  4.0.  Similarly,  tsi*  (tfc/s  (s- will  probably  require  more  rate 
control  than  will  Vj  fs3  = «c/S^  ■ When  one  considers  that  typical 

pilot  opinion  ratings  vary  uniformly  from  optimum  for  '<’« /s  " like 
controlled  elements  to  very  poor  for  highly  unstable  ones,  then  the  po- 
tential for  correlation  of  rate  feedback  "activity"  measures  with 
pilot  opinion  ratings  is  unmistakable. 

The  single  loop  servo  theory  for  human  dynamics  offers  no 
explanation  for  the  origin  of  control  stick  "pulsing"  that  is  known 
to  occur  in  tracking  experiments  with  controlled  elements  similar 
in  form  to  / S*"  or  for  certain  unstable  ones.  The  best  the 
Precision  Pilot  Model  can  offer  for  these  situations  are  rules  for 
selecting  the  lead  requirements  in  tlie  model  and  advice  about  the 
level  of  remnant  required  to  yield  reasonable  estimates  of  closed 
loop  signal  levels  (e.g.  see  references  15  and  16  for  a dis- 
cussion of  empirical  remnant  data) . The  model  cannot  replicate  the 
distributions  of  control  motion  - - which  are  typically  bimodal. 
Examination  of  the  nonlinear  pilot  model  structure  (figure  9) 

.suggests  an  immediate  explanation.  The  controlled  elements  for  which 
control  pulsing  is  known  to  occur  are  those  for  which  the  closed  loop 
response  is  highly  oscillatory.  The  phase  margins  measured  for 
closed  loop  systems  of  this  sort  would  be  minimum  and  approach  zero 
in  extreme  cases  (see  figure  13  which  is  a summary  of  phase  margin 
measurements  from  Che  reference  4 experiments).  The  closed  loop 
error  rate  for  these  systems  would  be  quite  periodic,  although  not 
exactly  sinusoidal.  The  periodic  content  of  error  rate  would,  however, 
be  sufficient  to  evoke  a pulsing  type  response  from  the  nonlinear 
delay  with  pulse  amplitudes  proportional  to  rate  amplitudes.  This 
nonlinear  response  would  then  become  the  "bimodal''  content  of  the 
control  response  S(t). 

More  comparisons  between  the  nonlinear  model  theory  and  the 
data  base  with  its  single  loop  servo  model  explanation  are  possible. 
However,  it  is  clear  from  the  above  discussions  that  a more  detailed 
model  for  the  nonlinear  elements  of  figure  9 would  be  of  considerable 
benefit  to  such  a comparison.  The  nonlinear  model's  structure 
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and  the  candidate  nonlinearities  can  create  a number  of  possible 
forms  for  ypCSf  ; these  can  serve  to  obscure  comparisons  almost  as 
much  as  to  provide  enlightened  understanding  of  experimental  behavior. 

It  is  important  to  understand  that  the  human  operator  does  not 
select  the  form  of  to  apply  given  a combination  of  input  and 

controlled  element.  According  to  the  nonlinear  model  hypothesis 
his  feedback  system  structure  is  fixed.  The  specific  feedback  non- 
linearities  create  system  respon.ses  which  require  '^(»')  forms  of  the 
sort  shown  above  for  their  explanation  in  classic  terms.  In  other 
words,  the  classic  lag  or  lead  equalization  may  only  be  apparent. 

Both  can  originate  with  rate  feedback  control.  Whether  the  rate  con- 
trol is  identified  as  a lead  or  a lag  activity  depends,  in  certain 
cases  (e . g.  C 41 = ) , upon  how  the  analyst  chooses  to  visual  a model 

for  human  controller  dynamics. 

If  one  is  to  extend  the  parallel  between  the  nonlinear  and 
single  loop  theories,  it  is  necessary  to  restrict  the  controlled  element 
to  those  that  are  adequately  modeled  by  linear,  constant  coefficient 
differential  equations  and  to  require  that  the  system  input  (command 
or  disturbance)  be  a near-gaussian  process.  These  restrictions  are 
necessary  to  stay  within  the  framework  of  the  servo  and  optimal  control 
descriptions  of  the  human  pilot.  The  data  base  for  pilot  dynamics 
is,  in  the  main,  characterized  by  these  same  limitations.  The  reader 
should  note,  however,  that  these  restrictions  need  not  apply  to  the 
multiple  loop,  nonlinear  model.  No  assumptions  of  that  sort  are 
required  in  its  development.  Nevertheless,  if  one  wishes  to  consider 
nonrandom  inputs  or  time-varying,  nonlinear  aircraft  responses,  it 
is  necessary  that  appropriate  models  for  physical  processes  be  pro- 
vided within  the  model.  For  example,  the  rate  sensor  dynamics  may 
not  be  the  same  for  discrete  inputs  as  for  continuous  ones;  the 
criteria  for  control  in  maneuvering  flight,  with  no  external  inputs, 
are  not  always  known  a priori  but  must  be  modeled.  With  regard  to 
the  latter  possibility,  it  must  be  recognized  that  not  all  human 
controller  activity  can  be  modeled  in  a genuinely  predictive  manner, 
nor  should  we  worry  about  this.  Our  concern  should  be  to  devise 
adequate,  predictive  models  for  controller  behavior  (including  his 
verbal  rating)  that  is  of  direct  interest  tn  aircraft  system  design 
and  design  optimization. 


SECTION  III 


A UNIFIED  MODEL  FOR  FI LOT  DYNAMICS  IN  SINGLE  LOOP 
TRACKING.  PART  2:  COMPUTER  SIMULATION  AND 

PARAMETER  SEARCHES 


A.  APPROACH 

Available  experimental  data  were  used  for  the  resolution  of  the 
postulated  nonlinear,  multiple  loop  pilot  model  in  structure  and 
detail.  Detailed  analytical  comparisons  were  attempted  between 
the  pilot  model  parameters  predicted  using  the  linearized  model 
shown  in  figure  10  and  the  experimental  results  of  reference 
4 - - plus  those  of  reference  14  to  a minor  extent.  This  was 
an  attempt  to  quantify  the  average  gains,  and  , and  the  con- 

stant of  proportionality  k in  the  nonlinear  time  delay  model: 


K 


It  was  a general  conclusion  of  this  work,  however,  that  the  analytical 
approach  was  not  likely  to  permit  quality  resolution  of  the  sort 
required  over  all  the  data  ranges. 

Another  difficulty  faced  in  the  validation  of  the  proposed 
model  was  the  dearth  of  time  response  data  available  for  comparison 
with  model  predictions.  The  reference  4 data  base  is  presented 
entirely  in  the  frequency  domain.  Hence,  the  choice  was  made  to 
program  the  pilot  model  and  the  controlled  element,  both  suitably 
parameterized,  on  a digital  computer,  use  sums  of  sine  waves  to 
generate  a command  input,  mechanize  an  analyzer  for  the  estimation 
of  the  pilot  model  describing  function  , and  adjust  model 

parameters  until  a match  could  be  obtained  of  y^tjeoi  with  those 
documented  in  reference  4 together  with  physically  reasonable 
system  time  responses.  In  the  actual  trials  the  emphasis  was  on 
obtaining  qualitatively  reasonable  time  responses,  both  in  amplitude 
and  temporal  character.  The  measurement  of  was  used  as  a final, 

quantitative  check  on  the  validity  of  the  model.  The  system  input  used 
was  precisely  that  of  the  reference  4 experiment  - - tabulated  in 
Table  1. 

The  original  intent  was  to  iterate  on  pilot  model  parameters 
until  a match  was  also  achieved  between  predicted  and  measured  values 
of  remnant,  correlation  coefficients,  signal  amplitude  distributions, 
and  power  spectral  density  of  the  control  S . This,  however,  was 
never  accomplished  due  to  failure  to  succeed  with  the  primary 
obj  ec  t Ives . 

The  decision  was  made  to  perform  all  parameter  searches  manually 
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''  from  an  intercom  terminal  with  a scope  presentation  of  system  time 

responses,  describing  functions  and  signal  statistics.  in  this 
way  a particular  baseline  combination  of  nonlinear  element  para- 
meters was  selected  for  a given  input  and  controlled  element;  the 
program  would  then  be  activated,  and  the  results  displayed  at  the 
terminal.  Variations  in  the  system  parameters  were  made  depending 
on  the  character  of  the  system  response.  This  was  done  by  the  author 
in  a trial  and  error  fashion.  Insight  provided  by  analytical 
approximations,  such  as  those  presented  in  the  previous  article, 
provided  useful  clues  to  assist  the  parameter  iteration. 

It  was  assumed  at  the  outset  that  the  nonlinearities  in  the 
multiple  loop  model  could  be  configured  to  simulate  human  response 
dynamics  for  specific  controlled  elements.  For  example,  selecting 
s 0 andGy=Kye^°*  (K^and  Xo  are  constants)  would  be  guaranteed 
to  basically  satisfy  the  validation  requirements  for  >efS)=Kt/S  or 
Kc  /(S-A)  . The  introduction  of  an  error  threshold  or  a tailored 

amp  1 i t ude-dependen  t gain  Ky=Ky(>r)  would  not  be  expected  to  qual- 
' I itatively  affect  the  simulation  fidelity.  The  problem,  however, 

^ was  to  devise  one  such  model  that  would,  with  minor  variation  (pre- 

ferably in  Gy),  simulate  all  five  pilot-vehicle  systems  under  con- 
. I sideration.  Almost  all  the  effort  was  directed  toward  this  goal. 


8.  MODEL  CONFIGURATIONS  TESTED 

There  are  an  infinity  of  possible  nonlinearities  and  ways  for 
combining  them  that  could  be  considered  in  a program  to  resolve  and 
validate  the  proposed  model  for  human  pilot  dynamics  (figure  9). 

The  successful  comparisons  between  the  linearized  version  of  this 
model  (figure  10)  and  the  Precision  Pilot  Model,  as  discussed  in  the 
last  section,  indicated  that  the  number  and  nature  of  required 
nonlinearities  is  probably  limited.  These  nonlinearities  were  intro- 
duced in  the  last  section. 


There  were  two  principal  classes  of  model  configurations  tested: 
t coordinated  control  of  error  and  error  rate  for  which  ^ /Sn  * /dy 

1 (figure  9)  and  mode  switching  between  control  of  either  error  or 

, error  rate,  exclusively.  These  will  be  described  here  in  sufficient 

^ detail  to  indicate  their  general  character,  only. 

Both  the  switching  and  non-switching  models  were  tested  with 
^ and  without  rate  washout  or  an  error  threshold.  Variable  and  constant 

gain  models  for  iCy  and  Ky  were  tested  for  each  of  these  combinations. 

^ An  error  rate  threshold  was  introduced  in  one  set  of  trials  for  the 

non-switching  model  with  constant  gain  values  for  andKy  . One  trial 
■tJ  was  made  in  whici:  the  nonlinear  delay  was  placed  in  the  error  loop 

with  constant  loop  gains  and  no  switching.  Another  trial  eliminated 
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rate  teedback  entirely  and,  instead,  introduced  a functional  depend- 
ence of  tbe  position  gain  on  and  ; viz.  , tCy  = , where 
p = constant.  Two  types  of  variable  gain  parameterization  were  used 
as  shown  by  the  following  sketches: 


Znpwf  1 ^ It.  lu  Input  HI 

Eight  switching  schemes  were  used  in  the  evaluation  of  the 
merits  of  the  switching  model.  These  are  listed  below.  The  first 
was  the  nominal  one,  used  for  most  simulations: 

1.  S~  p,Xp  ~ 

2.  S=p,'^D  , as  above  determined  the  control  mode 

when  ( an  arbitrary  value).  Otherwise  ■ 

^ z 

3.  S=  Pi  Xp  - determines  the  control  mode  when  IVyl  >>1 

Otherwise  fi- jiy  • 

4 . S-  pXp  -Yt  determines  the  control  mode  when  Yi.'^l^l^yu 

; ,4:/3y  when  lyVI  S 7i  ; /ix  when  f/yl  i . Both  Ti  and  K*  are 
arbitrary  parameters  that  are  intended  to  reflect  the  nearness  of 

the  closed  loop  state  (error  and  error  rate)  to  unacceptable  levels 
of  stability  or  to  display  saturation. 


5.  fi- /^x.  when  |Xi,|>Xm  (an  arbitrary  parametric  value); 

h IXol  £:  X„  . 

6.  whenlXoliXM  1 /4  - when  |Xol  » Xm 

7.  when /r  andXp  have  the  same  sign;  otherwise,/®  is 
determined  as  in  (1)  when  lx,l  i Xu,  and  (i- when  IXbI  > 'x„1 

8.  when  1X^1  » Xm  ; otherwise,  ^ is  determined  as  in 

(1). 


The  neuromuscular  system  dynamic  model  was  that  obtained  from 
reference  10;  viz.. 


All  computer  simulations 
puter  at  Wrig'  .-Patterson  Air 


were  conducted  on  the  CDC  6600  com- 
Force  Base,  Ohio. 


C . RESULTS 

The  accuracy  of  the  measurement  system  used  for  estimation  of 
the  describing  function  was  of  concern.  Therefore,  pre- 

liminary runs  were  conducted  to  examine  the  quality  of  the  measure- 
ment system  (discussed  in  Appendix  B)  and  to  establish  suitable 
values  for  time  step  sizes  and  run  lengths  to  avoid  the  introduction 
of  systematic  errors  in  the  measurement  process.  Certain  of  these 
data  sets  will  be  shown  later.  It  was  found  that  run  lengths  of  at 
least  40  seconds  and  time  steps  of  about  .0125  to  .025  seconds  were 
usually  sufficient  to  ensure  a reasonable  measurement  of  system 
dynamics.  The  exception  was  at  the  very  lowest  measurement  fre- 
quencies where  errors  (especially  in  phase)  are  practically  impossible 
to  eliminate  - - at  least  with  the  Fourier  coefficient  measurement 
scheme . 

A check  was  made  on  the  fidelity  of  the  neuromuscular  system 
model.  The  neuromuscular  system  equations  were  excited  with  the 
sums  of  sine  waves  input,  the  input  and  response  were  Fourier  trans- 
formed by  the  analyzer  described  in  Appendix  B,  and  the  transfer 
function  was  estimated  as  the  ratio,  at  each  input  fre- 

quency, of  the  output  to  input  Fourier  coefficients.  The  results 
are  shown  on  figure  14.  Both  the  amplitude  and  phase  estimates  are 
seen  to  be  in  excellent  agreement  with  the  analytical  values  when  the 
run  length  is  40  seconds.  Note  the  absence  of  scatter  and  compare 
this  result  with  measurements  made  later  with  a mode  switching  pilot 
model . 


Further  checks  were  made  of  the  measurement  technique  and  of 
the  programming  fidelity  by  measuring,  in  situ,  the  dynamics  of  the 
various  simulated  controlled  elements.  This  was  done  by  selecting 
parameters  for  the  pilot  model  which  yielded  a stable  and  reasonable 
closed  loop  response,  running  the  pilot-vehicle  simulation  for  a 
prescribed  time  period,  and  estimating  the  ratios  of  Fourier  coeffic- 
ients for  the  controlled  elements'  output  and  input.  The  results 
are  shown  in  figures  15-19.  The  pilot  models  used  for  the 
controlled  elements  >^(5)=M-9  , yj(S)=h.9/S  , and 

y^fS5a//.9  /fs-2)  all  used  coordinated  control  of  error  rate  and 
error  (i.e.,  ^ = */iy'  ) rather  than  mode  switching.  Mode 

switching  models  for  pilot  dynamics  were  used  for  measurements  of 

//.9/S*’  and  >e  C*>  = //.9/S(S-Zj  . In  all  five  cases  constant 
gain  models  were  used. 

The  measured  data  for  are  interesting  and  deserve  comment. 
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There  is  a qualitative  diflereiu'.e  Detweeii  tiie  results  obtained  for 
the  coordinated  control  pilot  models  (fugures  15-17)  and  those  for  the 
mode  switc'ning  models  (figure  18  and  19).  With  the  coordinated  control 
models,  the  measured  converge  toward  tiie  theoretical  values 

as  the  step  size  is  decreased  and  as  tlie  running  time  is  extended. 

This  is  not  necessarily  the  case  for  the  mode  switcliing  pilot  models. 

For  these,  considerable  variation  in  measured  ^ - - especially 

the  low  frequency  phase  - - is  obtained  with  changes  in  running  time  or 
step  size.  Further,  there  is  no  clear  trend  toward  convergence, 
particularly  for  the  case  s (i.9/s  ( s - Z ) . An  exception  to  these 

remarks  occurs  in  the  mid-frequency  region  near  the  expected  crossover 
frequency.  There,  the  variability  in  measured  phase  and  amplitude  is 
virtually  nonexistent  for  all  conditions  shown. 

In  reference  4,  it  is  noted  that  considerable  variability  in  the 
measured  human  operator  describing  function  is  usually  obtained  for  a 
number  of  trials  with  the  same  subject  or  between  different  subjects. 

In  the  experiments  this  variability  was  found  to  be  minimum,  however, 
near  the  crossover  frequency.  Reasons  for  this  have  never  been  deter- 
mined, but  the  authors  of  reference  4 suggested  that  the  crossover 
frequency  has  an  important  bearing  on  system  stability  and  perfor- 
mance; therefore,  all  subjects  will  be  constrained  in  their  dynamic  re- 
sponse near  the  crossover  condition  - - hence  the  low  variability  of 
measurents  near  crossover.  It  was  further  suggested  that  variability 
in  measurements  at  other  frequencies  reflects  operator  "style"  variations 
which,  by  and  large,  aren't  too  important  to  system  dynamics  and  per- 
formance. Here,  in  the  measurement  of  controlled  element  dynamics, 
we  see  a similar  sort  of  measurement  result  that  would  be  difficult  to 
attribute  to  "style"  of  the  computer  pilot!  The  matter,  however,  will 
not  be  considered  further  in  this  report. 

It  was  generally  difficult  to  select  parameters  for  the  pilot 
model  that  would  produce  a stable  closed  loop  system.  Stability  in  a 
nonlinear  system  is  often  difficult  to  ascertain;  these  were  no 
different  in  that  respect.  The  nature  of  the  nonlinearities  selected 
for  the  pilot  model,  together  with  the  typical  closed  loop  dynamics 
sought,  tended  to  produce  limit  cycles  in  many  of  the  cases  examined. 

It  was  no  easy  matter  to  identify  observed  oscillations  as  a limit 
cycle  or  to  diagnose  stability  due,  mainly,  to  contaminating  effects  of 
tlie  system  input.  The  input  was  replaced,  in  a few  cases,  with  initial 
conditions  on  the  motion  in  order  to  more  easily  resolve  questions  of 
system  stability.  This  was  unsatisfactory,  however,  since  the  lack  of 
a continuous  input  was  often  sufficient  to  change  the  closed  loop  response 
in  a qualitative  way.  Thus,  the  experimental  evidence  was  that  the 
pilot-vehicle  system  model  could  not  be  divorced  from  the  system  input 
wlien  searctiing  for  its  identifying  parameters.  A typical  problem  en- 
countered in  the  conduct  of  these  parameter  searches  was  that  a 
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Lombiaation  of  moiiel  parameters  would  yield  closed  loop  time  responses 
that  were  stable  for  a number  of  seconds  (usually  15  to  20  seconds 
from  problem  initiation)  and  then  suddenly  diverge. 

A general  observation  from  the  examination  of  several  hundred 
system  time  responses  and  dozens  of  measured  pilot  model  describing 
functions  was  that  is  not  a very  sensitive  measure  for 

pilot-vehicle  system  dynamics.  It  appears  that  - - at  least  for 
systems  characterized  by  figure  9 - - qualitative  changes  can  be 
created  in  closed  loop  time  response,  due  to  variations  of  model 
parameters,  without  major  change  to  the  describing  function. 

The  original  description  of  the  postulated  pilot  model  did  not 
have  mode-switching  as  a candidate  nonlinearity.  Switching  was  in- 
cluded in  an  attempt  to  create  the  lagging  low  frequency  phase 
in  measured  Yp  . It  was  found  by  trial  and  error  that  the 

incorporation  of  unrealistically  large  thresholds  in  both  the  error 
and  error  rate  channels  would  produce  a sizable  low  frequency  phase 
lag.  The  closed  loop  time  responses  were,  however,  physically  un- 
realistic. An  examination  of  the  system's  response  suggested  that 
error  rate  was  usually  large  when  error  was  small,  and  vice  versa. 
Accordingly,  the  dual  thresholds  operated  like  a switch  to  dictate 
the  control  of  either  error  or  error  rate.  A mode  switch  of  the  form 

3 = P.  - >'r 

= /4*  ( S>o) 

P>--  jiy  (S*0) 

was  then  introduced  as  a candidate  nonlinearity.  It  is  physically 
reasonable  and  is  easily  programmed. 

A major  thrust  of  this  effort  was  to  devise  a set  of  parameters 
for  the  pilot  model  nonlinearities  that  would  be  invariant,  or  nearly 
so,  with  changes  in  controlled  element  or  input.  This  goal  was  not 
achieved.  It  was,  in  fact,  difficult  to  stabilize  the  "easier-to- 
control"  >^<SJ  without  forcing  error  rate  control  to  be  near-zero. 
Levels  of  rate  feedback  for  >eCS3=Kc  , K^/s  ^ Kg/(s-z)  sufficient 
to  contribute  significant  power  to  would  almost  certainly 

destabilize  the  closed  loop.  The  elimination  of  rate  control  from 
these  cases  was,  however,  defeating  the  purpose  of  the  entire  program. 

A potential  solution  to  the  dilemma  was  to  Introduce  nonlinear  gains 
Kk(Xb')  and  KyCvV)  , configuring  these  in  such  a way  that  the  closed  loop 
signal  amplitudes  would  yield  the  appropriate  loop  gains  for  all 
controlled  elements.  This  was  the  origin  of  the  nonlinear  gain  model. 
Unfortunately,  no  acceptable  configurations  wore  found  for  the  nonlinear 
gain  models  and  Ky  CYr)  . It  was,  in  fact,  often  a 

struggle  merely  to  stabilize  the  closed  loop  system  with  the  gain 
models  previously  discussed. 
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A limited  amount  of  success  was  adiieved.  Ihe  controlled 
element  was  extremely  difficult  to  stabilize;  after 

considerable  difficulty,  a mode-switching  model  for  the  human  pilot 
was  devised  which  would  stabilize  the  closed  loop  and  yield  reasonable 
time  responses.  This  same  pilot  model,  without  modification,  was  applied 
to  the  control  of  csj  i K.s/s*’  . The  resulting  closed  loop  system 

was  stable  and  produced  very  reasonable  signal  behavior.  The  measured 
for  these  two  \ are  shown  in  figures  20  and  21.  The 
shaded  regions  on  both  figures  represent  the  variations  obtained  in  the 
data  measured  in  the  reference  4 experiments.  It  seemed  reasonably 
clear  that  with  a certain  amount  of  tailoring,  the  multiple  loop  pilot 
model  could  provide  an  excellent  match  to  these  data.  The  more 
important  part  of  the  problem,  however,  was  somehow  to  transform  this 
successful  model  into  one  that  was  equally  applicable  without  change 
to  the  other  three  controlled  elements.  This  was  attempted  without 
success . 


D.  CONCLUSIONS 

The  results  of  the  trial  and  error  computer  experiment  were  incon- 
clusive. The  properties  of  specific  nonlinear  pilot  models  were  often 
such  as  to  entice  the  author  into  believing  that  a major  success  was 
within  his  grasp;  but  this  never  materialized.  On  the  other  hand,  the 
modeling  approach  still  looks  reasonable.  No  results  wei e obtained 
that  refute  the  philosophy  behind  it.  However  the  study  has  confirmed 
to  this  author  the  truth  of  tales  of  manifold  horrors  that  can  be 
encountered  in  the  study  of  nonlinear  systems.  In  a way,  this  author 
is  left  feeling  a little  like  a virgin:  slie  thinks  she  knows  - - and 

she  does  - - but  she  hasn' t the  experience. 

No  indication  was  found  to  suggest  that  a nonlinear  pilot  model 
could  not  account  for  a considerable  portion  of  what,  in  past  work, 
has  been  called  "pilot  adaptability."  Instead,  the  successful  appli- 
cation of  one  such  model,  without  change,  to  two  controlled  elements 
suggests  that  hypothesis  1 of  Section  II  is  well-founded.  However, 
even  if  the  approach  is  completely  valid,  it  will  probably  be  exceed- 
ingly difficult  to  resolve  the  pilot  model  in  detail.  Additional  data 
on  the  modality  of  visual  sensing  may  be  required  for  this  purpose. 

The  mode-switching  model  appears  to  be  a very  attractive  avenue 
to  pursue  with  future  research.  The  present  study  showed  that  it  has 
features  that  are  attractive  in  single  loop  tracking.  Unfortunately, 
this  study  could  not  say  conclusively  that  mode  switching  is  an 
appropriate  model. 

Three  possible  sources  were  identified  for  lagging  phase  of  tlie 
pilot  describing  function  I'  « j oj ) at  low  frequencies.  These  are 
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the  closed  loop  effects  of  a nonlinear  time  delay  in  the  rate  sensor, 
a rate  loop  washout,  and  a mode  switching  between  control  of  error 
to  control  of  error  rate  and  vice  versa.  In  general,  it  appears  that 
mode  switching  is  partly  responsible  for  low  frequency  variability  in 
measurements  of  . It  is  plausible  to  suspect  that  short- 

term variations  in  the  nonlinear  delay  X due  to  variations  in  the 
peak  amplitudes  of  closed  loop  error  rate  are  largely  responsible  for 
higher  frequency  variations  in  experimentally  measured 

The  interface  provided  an  analyst  by  a computer  terminal  intercom 
is  not  sufficient  for  addressing  this  problem.  A more  timely  interactive 
capability  is  required  if  a trial  and  error  approach  is  ever  to  succeed 
in  defining  the  details  of  the  postulated  pilot  model.  It  would  seem 
that  a large-scale  hybrid  computer  could  be  successfully  applied  to 
this  problem.  Such  a facility  would  permit  the  nonlinearities  (espe- 
cially the  nonlinear  delay)  to  be  programmed  on  the  digital  portion  of 
the  computer;  the  analog  features  would  provide  a capability  for  the 
analyst  to  make  potentiometer  adjustments  while  observing  system  re- 
sponse. This  "instant  feedback"  feature  could  permit  the  rapid  con- 
vergence to  acceptable  time  responses  that  are  required  if  the  pos- 
tulated pilot  model  is  to  receive  an  exhaustive  evaluation. 


48 


SECTION  IV 


PREDICTION  OF  PILOT  OPINION  RATING 


A.  GENERAL  COMMENTS 

Any  discussion  of  pilot  opinion  rating  prediction,  collection, 
or  evaluation  will  lead  sooner  or  later  to  the  introduction  of  terras 
like  "pilot  variability"  or  "pilot  set."  These  connote  a randomness 
in  a pilot's  ability  to  produce  consistent  rating  of  a given  task  or 
rating  biases  that  one  pilot  may  display  as  a result  of  his  personal 
tastes,  prior  experiences,  whimsy  or  other  factors  too  elusive  to 
classify.  If,  indeed,  an  evaluation  pilot's  capabilities  for  objective 
and  quantitative  task  or  configuration  ratings  are  significantly 
influenced  by  factors  that  bear  no  more  than  peripheral  relation  to  the 
task,  then  useful  predictions  of  pilot  ratings  may  be  impossible  to 
achieve  in  other  than  contrived  circumstances. 

However,  there  is  another  viewpoint  on  this  matter  that  has  never 
been  systematically  addressed.  Could  not  random  appearing  scatter 
in  rating  data  result  from  a simulation  or  flight  test  that  involves 
factors  beyond  the  experimenter's  control  or  that  are  unknown  to  him? 

Might  not  biases  in  a pilot's  rating  result  from  a poorly  conceived 
experiment  in  which,  for  example,  the  operational  task  to  be  rated  is 
only  tenuously  connected  with  the  experiment  or  for  which  the  specific 
operational  problem  is  ill-defined  to  the  pilot?  Can  unbiased  ratings 
be  produced  by  a subject  who  has  limited  experience  in  the  purpose  and 
use  of  the  rating  scale?  We  really  know  very  little  about  the 
"physiology  of  ratings"  or  about  whether  a physical  basis  for  them 
exists.  Accordingly,  it  is  reasonable  to  hypothesize  that  the  short- 
comings of  the  current  base  of  pilot  opinion  rating  data  reflect  our 
lack  of  knowledge  of  rating  mechanics  as  much  as  the  inadequacies,  real  ? 

or  imagined,  of  the  pilot  as  an  evaluator  of  system  quality. 

With  neither  a physical  theory  for  pilot  opinion  rating  nor  the 
knowledge  that  such  a theory  cannot  be  devised,  it  is  logically  im- 
possible to  categorize  "inconsistencies"  in  pilot  opinion  ratings  as 
apparent  or  real.  An  early  theory  for  pilot  opinion  rating  derived  from 
the  single  loop  servo  theory  for  pilot  dynamics.  This  theory,  circa 
1960,  hypothesized  that  the  pilot's  equalization  requirements,  as 

measured  within  the  context  of  this  control  theoretic,  would  quantify  9 

task  difficulty  and  therefore  correlate  with  rating  data.  Applications 
established  that  a correlation  did  exist  but  that  equalization,  as 
defined  by  the  servo  model,  was  not  sufficient  for  the  complete  corre- 
lation or  prediction  of  pilot  ratings.  There  is  something  more  in- 
volved . 
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An  intuitive  notion  that  has  long  been  popular  in  certain  circles 
is  that  pilot  opinion  should  correlate  with  measures  of  tracking  per- 
formance in  the  closed  loop  system.  Numerous  experiments,  however, 
have  shown  ti’.at  good  performance  does  not  necessarily  indicate  good 
ratings,  and  vice  versa.  Still,  the  notion  persists.  It  isn't  clear, 
for  example,  what  "performance"  might  mean  to  an  evaluation  pilot; 
this,  of  course,  has  provided  another  research  tangent  with  which  the 
man-machine  community  can  grapple. 

There  is  something  intuitively  satisfying  about  correlating  a 
pilot's  rating  with  how  hard  he  must  work  to  perform  the  assigned  task. 

The  "workload"  notion,  however,  which  conceptualizes  a metric  for 
quantifying  this  relation,  has  introduced  another  red  herring  to  flying 
qualities  research;  the  search  for  a pilot  workload  measure  seems  to 
have  become  an  end  in  itself. 

McDonnell  addressed  the  three  topical  areas  above  (viz.,  pilot 
dynamics,  pilot  performance,  and  task  difficulty)  plus  an  important  new 
one  - - the  pilot  opinion  rating  scale.  He  considered  the  general 
problem  of  how  a scale  for  the  quantification  of  pilot  opinion  can 
contribute  to  both  systematic  and  random  errors  in  rating  data;  he 
suggested  an  alternate  scale  derived  from  the  application  of  psychometric 
principles.  McDonnell  did  not  question  the  e.xistence  of  a ph.ysical 
basis  for  pilot  ratings  but,  by  implication,  assumed  its  existence. 

He  concluded  that  . . . "ratings  are  probably  based  on  performance  and 
the  degree  of  difficulty  experienced  in  maintaining  the  performance. 

The  difficulty  is  most  easily  represented  by  the  pilot  equalization  re- 
quired and  the  vehicle  stick  characteristics"  ...  reference  17. 

Anderson  (reference  3)  proposed  a formal  method  for  the  prediction 
of  pilot  opinion  ratings.  The  method  is  based  on  the  assumption  that 
a pilot  will,  in  some  way,  adjust  his  equalization  to  optimize  his  own 
ratings.  It  requires  a "rating  functional"  which  formally  connects 
system  performance  (typically,  expressed  as  mean-squared  error),  pilot 
equalization,  and  pilot  rating.  The  method,  now  genetically  known  as 
"Paper  Pilot,"  provided  the  first  rational  treatment  of  the  combined 
effects  on  pilot  ratings  of  system  performance  and  pilot  dynamics. 

There  is,  however,  no  known  physical  basis  for  the  Paper  Pilot 
concept  of  rating  optimization.  Like  workload,  the  concept  is  pliil- 
osophically  interesting,  difficult  or  impossible  to  disprove,  and 
intuitively  satisfying  to  some.  It  suffers  from  two  principal  limita- 
tions. First,  a rating  functional  is  required  which,  when  minimized  via 
applications  of  linear,  optimal  control  theory,  will  yield  a numerical 
estimate  of  pilot  opinion  rating.  There  is  no  physical  rule  for  selecting 
the  functional;  past  applications  of  the  Paper  Pilot  method  have  used 
functionals  based  on  statistical  correlations  of  rating  with  performance 
and  servo  model  parameters.  Unfortunately  the  functionals  derived  for 
past  studit!s  have  not  been  unique;  it  is  difficult  or  impo.ssiblc  to  select 
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The  second  limitation  of  tlie  Paper  Pilot  methodology  concerns  the 
fidelity  with  which  one  can  predict  the  parameters  in  the  st^rvo  model 
for  human  pilot  dynamics.  This  is,  in  general,  a difficult  and  some- 
what artistic  task.  UTien  done  to  the  level  of  detail  required  by  the 
Precision  Pilot  Model  (reference  4)  it  is  not  well  suited  to  the 
iterative  solution  methods  required  for  applications  of  optimal  control 
theory.  Simplified  and  less  accurate  pilot  model  forms  are  normally 
used  - - especially  for  multiple  loop  control  tasks  where  considerable 
artistry  must  be  employed  in  their  selection. 


It  may  be  that  the  true  value  of  the  Paper  Pilot  theory  is  that  it 
represents  a new  way  of  thinking  about  pilot  rating  data  and  has 
carried  rating  discussion  to  a new  level  of  sophistication.  Further, 
tlie  occasional  success  of  the  theory  is  cause  for  real  hope  that  pilot 
opinion  is  based  on  (unknown)  physical  considerations  and  may,  therefore 
be  predictable.  However,  no  method  for  the  prediction  of  ratings  is 
of  more  than  academic  interest  v;ithout  a self-consistent,  physical 
theory  which  can  bound  its  limits  of  validity.  An  empirically  derived 
model  may  be  perfectly  satisfactory  for  data  correlation  or  for  inter- 
polation over  a data  set;  it  is  of  limited  value  for  prediction  in  the 
absence  of  data  and  of  no  value  for  extending  the  flying  qualities 
specification  into  areas  of  novel  control  methodology  or  unusual  air- 
frame dynamics. 


In  this  section  it  will  be  assumed  that  a physiological  basis  exists 
for  pilot  rating,  that  its  character  is  suggested  by  the  nonlinear, 
multiple  loop  pilot  model  of  Section  II,  and  tliat  this  leads  to  a 
unique  handling  quality  metric  for  the  prediction  of  pilot  opinion 
ratings.  The  metric  will  be  evaluated  for  a particular  set  of  single 
loop  tracking  dt ta.  It  will  also  be  used  for  preliminary  examination 
of  a multiple  loop  control  task.  General ixations  will  be  made  about 
the  metric,  its  connections  with  Paper  Pilot  and  some  short-comings  of 
the  pilot  me  "'ling  state-of-the-art. 

B.  IMPLICATIONS  OF  THE  NONLINEAR,  MULTIPLE  LOOP  PILOT  MODEL 

It  appears  to  be  generally  true  that  in  single  and  multiple  loop 
tracking  tasks  the  amount  of  pilot  lead  equalization,  as  determined 
from  the  servo  model  for  pilot  dynamics,  is  an  indication  of  good  or 
poor  pilot  opinion  ratings.  However,  there  are  situations  where  poor 
ratings  are  obtained  while  only  a small  lead  is  measured,  and  vice  versa. 
Further,  it  has  been  well  documented  tliat  pilot  opinion  of  a flight 
control  task  is  as  much  a function  of  input  intensity  as  of  vehicle 
dynamics  per  se.  The  conventional  servo  model  for  human  pilot  dynamics 
does  not  admit  variations  in  pilot  equalization  with  input  amplit\ide. 
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Thus,  lead  (or  lag)  equalization  is  not  a suitable  metric  for  pilot 
opinion  - - at  least  from  the  viewpoint  provided  by  the  servo  model. 

Use  of  the  servo  model  (e.g.  figure  1)  will  seriously  handicap 
any  analysis  of  pilot  opinion  rating  prediction  if  a physical  rating 
mechanism,  internal  to  the  human  pilot,  exists  as  assumed  here.  By 
present  theory  we  must  conclude  that  the  servo  model  is  basically 
flawed  in  that  it  intermixes  the  effects  of  proportional  and  rate 
control.  This,  of  course,  is  the  result  of  its  treatment  of  input 
as  a scalar  quantity.  If  pilot  opinion  rating  and  task  difficulty 
are  related  one-to-one,  and  if  pilot  equalization  is  a reasonable 
measure  of  task  difficulty,  then  past  failures  to  correlate  equali- 
zation entirely  with  rating  can  reasonably  be  attributed  to  short- 
comings in  the  servo  description  of  human  pilot  dynamics  as  a model 
for  pilot  equalization. 

The  simplified  analyses  comparing  the  properties  of  the  servo 
and  multiple  loop  models,  given  in  Section  II  Article  G of  this  report, 
have  established  the  plausibility  that  the  servo  model  equalization 
terms  (lead  and  lag)  derive  entirely  from  rate  feedback  when  this  is 
treated  as  a distinct  information  path  as  in  the  multiple  loop  pilot 
model.  The  significance  of  this  observation  is  that  for  a constant 
input  level  it  appears  to  permit  the  relative  ranking  of  controlled 
elements  according  to  the  level  of  rate  feedback  required  to  yield  closed 
loop  dynamics  as  determined  by  experiment.  This  ranking  is  important 
because  it  appears  to  be  consistent  with  the  known  trend  of  pilot 
opinion  rating  over  these  same  controlled  elements.  It  was  indicated  in 
Section  11,  for  example,  that  in  order  of  increasing  rate  feedback 
requirements  we  would  probably  have  > «c  > ’ -jm  , • 

A metric  which  quantifies  the  level  of  rate  feedback  control  might  also 
quantify  the  pilot  opinion  rating. 

Thus,  a duality  appears  to  exist  between  pilot  opinion  rating  and 
the  level  of  rate  feedback  required  by  the  multiple  loop  pilot  model 
for  a prescribed  control  task  and  with  constant  input  intensity. 
Furthermore,  if  it  is  assumed  that  the  level  of  rate  control  "activity" 
is  the  harbinger  of  pilot  opinion  rating,  then  it  is  reasonable  to  expect 
that  a rating  metric  based  on  this  property  will  encompass  effects  on 
rating  due  to  input  intensity  as  well  as  those  due  to  controlled  element 
dynamics.  This  corollary  follows  immediately  from  the  multiple  loop 
model  structure  (figure  9)  where  it  is  apparent  that,  regardless  of 
how  one  defines  rate  control  "activity,"  an  activity  metric  will  be 
dependent  upon  closed  loop  dynamics  (especially  the  amplitude  and 
frequency  of  the  dominant  mode)  and  input  statistics. 


C.  A MKTRIC  FOR  RATING  PREDICTION  IN  SINGLE  LOOP  TRACKING 

The  notion  of  rate  loop  "activity"  introduced  in  the  last  article 
is  a bit  ethereal  and  of  no  more  practical  value  than  "workload"  or 
"task  difficulty"  measures  unless  it  can  be  quantified  in  a unique  way 
which  derives  from  a physical,  rather  than  intuitive  or  statistical, 
theory.  The  following  two  hypotheses  are  therefore  proposed: 

HYPOTHESIS:  A general,  physiological  measure  for  rate  control  "activity" 

in  single  loop  tracking  is  the  rate  of  nerve  impulses  (or  an  equivalent 
physical  measure)  at  the  point  within  the  central  nervous  system  where 
all  signals  originating  due  to  rate  control  are  summed.  The  neuro- 
muscular system  is  postulated  to  provide  a component  to  this  hypothe- 
sized signal  Junction;  this  component  is  dependent  upon  the  feel  sys- 
tem characteristics  and  will  affect  pilot  rating.  In  the  remainder 
of  this  report  the  contributions  of  the  feel  system  to  pilot  opinion 
will  be  discounted  by  assuming  that  the  control  system  force  and  dis- 
placement sensitivities  are  optimized  with  respect  to  pilot  opinion 
rating.  Then  to  the  extent  that  the  control  feel  is  optimum,  the  nerve 
impulse  rate  due  to  rate  feedback  control  will  be  uniquely  related  to 
pilot  opinion. 

HYPOTHESIS:  The  relation  between  pilot  opinion  and  nerve  Impulse  rate 

at  the  summation  point  of  all  signals  originating  due  to  rate  control 
is  fixed  for  each  pilot.  It  may  depend  upon  his  piloting  experiences, 
training  and  his  personal  interpreta,.ion  of  the  pilot  opinion  rating 
scale.  It  is  independent  of  controlled  element  dynamics,  input  char- 
acteristics, and  task  specifics. 

Measurements  of  central  nervous  system  activity  such  as  that 
proposed  above  are  not  available  in  the  handling  qualities  literature 
and,  in  all  probability,  are  beyond  the  present  state-of-the-art  of 
medical  science.  Within  the  context  of  the  multiple  loop  model  (figure  9), 
what  we  seek  is  a measure  for  the  level  of  the  signal  yfl*  (the  rate 
loop  output  to  the  neuromuscular  system) . The  root  mean  square  value 
might  suffice,  but  it  is  not  directly  measurable.  On  an  average 
basis  terms  for  which  measurement  may  be  possible  can  be  substituted  for 

. Observe  that,  with  Xj  * "Xw  in  figure  9, 

where  Xs  is  the  rate  error  as  sensed  by  tjij^  human  pilot  and  Xr  is 
the  average  equivalent  gain  in  the  rate  channel  between  and  . 

In  general.  will  not  equal  ; in  particular,  the  visual  display 

may  insert  nonl inearities  or  additional  dynamics  into  the  rate  channel 
between  Xg  and  . The  signal  is  not  measurable.  However, 

where  i.s  the  average  equivalent  gain  in  the  rate  channel  between 
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and  - - in  eflvct,  a display  gain.  Finally,  tlie  proposed 

molrif  for  [lilot  opinion  rating  is  just 

I <'8^ 
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In  accordance  Vviitli  tlie  above  discussion,  it  is  hypothesized  that  a 
raonotonic  relation  will  exist  between  and  pilot  rating  in  the  manner 

shviwn  on  figure  22. 


A principal  reason  for  the  work  described  in  Sections  II  and  III 
on  tlie  development  of  a multiple  loop  model  for  the  human  pilot  was  to 
enable  the  prediction  of  tlie  gain  product  Kg  . At  this  writing, 
however,  this  has  not  been  achieved.  The  reader  should  recall  that  a 
basic  proposition  of  this  modeling  study  was  that  the  model  sought  will 
unify  existing  pilot  models,  viz.,  the  conventional  single  loop  servo 
model  and  the  Kleinman  model.  It  is  contended  that  both  these  state- 
of-the-art  models  are  satisfactory  in  a limited  sense  but  are  sub- 
sumed by  a nonlinear,  multiple  loop  model  similar  in  structure  to  that 

shown  in  figure  9.  Therefore  it  is  reasonable  to  believe  that  either 

the  servo  or  the  Kleinman  model  could  be  used  for  the  estimation  of 
0^^  , in  lieu  of  a more  accurate  model. 

If  the  Kleinman  model  is  used  for  the  estimation  of  , then 

<K,^Kp,Q-Xe|  09) 

where  (see  figure  2) 

Kx  = optimal  controller  gain  in  the  x(rate)  channel. 

Kfx - an  equivalent  gain  for  the  Kalman  filter. 

Kpj,  = an  equivalent  gain  for  the  state  predictor. 

Kd^  = an  equivalent  display  gain. 

There  is  a certain  risk  entailed  in  the  use  of  the  Kleinman  model  for 
this  purpose.  It  was  devised  as  a tool  for  the  estimation  of  system 
performance.  It  contains  no  guarantee  that  it  can  accurately  predict 
system  properties  at  the  high  level  of  detail  required  here.  Furthermore, 
it  has  already  been  mentioned  that  the  Kleinman  model  requires  the 
selection  of  a cost  functional  and  weighting  factors  for  the  terms  in 
this  functional.  We  have  no  physical  guarantee  that  a cost  functional 
and  its  weights  will  apply  to  tasks  other  than  that  for  which  they  are 
tailored  to  match  system  performance  measures.  Another  difficulty 
will  arise  if  the  controlled  element  gain  (which  is,  typically,  a 
control  effectiveness  derivative  such  as  Mgg  ) is  non-optimum  with 
respect  to  pilot  opinion  rating.  The  Kleinman  mode^  merely  adjusts 
K*  to  optimize  the  gain  product  “ ■ i-e.,  i'’  dependent  on 

Kc  . The  pilot  opinion  metric  , however,  is  independent  of 

(j;  . Therefore,  when  the  Kleinman  model  is  used  for  the  estimation  of 


54 


r 


f 1 


I « 


CT/%,  the  predicted  value  of  must  be  normalized  with  respect  to 
the  value  of  for  which  pilot  opinion  is  optimized.  Any  subsequent 
prediction  of  pilot  rating  will  therefore  apply  only  to  those  aircraft- 
controller  configurations  for  which  the  control  feel  characteristics 
have  been  optimized  with  respect  to  pilot  opinion  rating.  Experimental 
measurements  of  the  terms  of  equations  18  or  19  can  only  be  correlated 
with  pilot  opinion  rating  if,  during  the  experiment,  the  control  system 
gain  was  optimized  with  respect  to  pilot  opinion  at  each  configuration 
tested. 

It  is  reasonable  to  expect  that  the  neuromuscular  system  con- 
tributes (through  muscular  tension,  perhaps)  to  the  nervous  system 
activity  at  the  point  where  the  rate  control  signals  are  summed,  and 
that  if  this  effect  were  included  in  the  estimation  of  then  the 

effects  on  pilot  rating  due  to  non-optimum  control  feel  characteristics 
could  also  be  predicted.  There  are  insufficient  data  available  for  this 
purpose  at  the  present  time;  it  is  also  beyond  the  scope  of  the  present 
study  and  will  not  be  considered  further. 

The  remarks  concerning  the  effects  of  nonoptimum  controller  gain 
on  pilot  opinion  rating  apply  equally  well  to  the  single  loop  servo  model 
for  pilot  dynamics.  If  the  servo  model  is  used  for  the  estimation  of 


, then  equation  18  is  replaced  with 


The  product  Kp\  is  the  servo  model  apjjroximation  to  the  rate  controller 
gain.  It  is  a valid  approximation  to  Kx  in  the  Kleinman  model  only  for 
certain  conditions  that  cannot  be  prescribed  a priori.  Equation  20 
sViould  be  used  only  as  a last  resort.  The  problem  with  the  conventional 
servo  model,  from  the  viewpoint  of  the  proposed  pilot  model,  is  that  it 
requires  no  lead  and  therefore  no  rate  feedback  for  three  broad  classes 
of  controlled  element  configurations,  viz.,  cs5 = Kc  . Kc  /s  ^ 

Kc  /cs-x)  . For  each  of  these  the  nonlinear  model  for  pilot  dynamics 
- - which  is  claimed  to  more  precisely  model  human  physiological  process 
mechanics  - - will  possibly  yield  considerable  rate  feedback  activity. 

Thus,  equation  20  is  strictly  inapplicable  when  Tj_  O . The  Kleinman 
model  apparently  does  not  suffer  from  this  same  limitation.  Therefore 
equation  19  is  recommended  as  an  interim  formula  for  the  estimation  of 

The  metric  implicitly  includes  effects  on  pilot  opinion 

rating  due  to  controlled  element  dynamics,  disturbance  or  command  inputs, 
or  task  requirements.  It  is  hypothesized  that  if  the  generic  relation 
between  pilot  rating  and  0~/i^  shown  in  figure  22  can  be  quantified  for 
any  single  loop  tracking  task,  then  the  result  can  be  used  as  a cali- 
bration of  rating  vs.  for  any  other  single  loop  tracking  task!  Further, 

it  is  hypothesized  that  if  0^^  could  be  measured  from  flight  test  or 
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simulation  experiments  in  which  pilot  ratings  are  also  obtained, 
then  the  ratings  would  be  entirely  correlated  with  in  the  sense 

that  a plot  of  rating  vs.  would  yield  a single-valued  curve  of  the 

form  shown  in  figure  22.  Then,  to  the  extent  that  effects  on  rating 
due  to  control  feel  characteristics  have  been  minimized,  can  be 

considered  as  the  magical  and  long-sought  workload  measure  for  pilot 
opinion. 


D.  VALIDATION  OF  THE  RATING  METRIC  FOR  SINGLE  LOOP  TRACKING 

By  above  hypothesis  the  proposed  metric  for  pilot  opinion  rating 
can  be  correlated  with  rating  data  obtained  from  any  handling 
quality  experiment  provided  sufficient  data  are  measured  to  permit 
the  estimation  of  0^^  . [As  an  aside,  we  must  estimate  0^^  . via 

the  use  of  experimental  data  and  a model  for  pilot  dynamics,  until 
such  time  as  a technique  can  be  devised  for  its  direct  measurement 
by  experiment. ] Almost  no  such  data  exists. 

Reference  18  is  the  notable  exception  known  to  this  author. 

Arnold's  pilot  opinion  rating  data  were  obtained  from  a fixed  base 
simulation  of  pitch  attitude  tracking  in  turbulence  with  fighter-type 
aircraft  dynamics.  His  experiment  was  conducted  using  five  current 
service  pilots,  each  of  whom  had  broad  operational  experience  in  the 
type  of  aircraft  and  task  being  simulated.  The  task  definition  was 
prescribed  with  the  aid  of  the  subjects;  their  principal  contribution 
to  the  experimental  design  was  to  select  an  attitude  display  config- 
uration (cathode  ray  tube  simulation  of  IFR  tracking  in  pitch)  and 
level  of  turbulence  intensity  that  seemed  realistic  in  an  operational 
sense.  Further,  the  subjects  were  instructed  to  fly  the  simulation  just 
as  they  would  the  actual  airplane.  [This  approach  to  simulation  of 
handling  quality  problems  seems,  to  this  author,  to  make  much  more  sense 
than  the  pedantic  one  in  which  all  simulation  parameters  are  pre-sel- 
ected by  the  analyst.  The  results  from  such  simulations  are,  of  course, 
valid  in  some  sense,  the  question,  however,  is  to  determine  their  meaning 
in  a flight  environment.]  Arnold's  display  contained  a sizable  threshold 
introduced  to  promote  task  realism.  The  predominant  effect  of  this 
display  was  to  eliminate  the  display  of  small  pitch  changes  about  the 
reference  attitude  such  as,  for  example,  those  duo  to  "nose  bobble". 
Fourteen  aircraft  configurations  were  evaluated.  Each  was  flown  sev- 
eral times  by  each  subject  and  average  pilot  opinion  ratings  were  ob- 
tained. The  configurations  selected  had  previously  been  flight  tested 
in  the  USAF  variable  stability  T-33  (reference  19).  Arnold's  pilot 
ratings  were  intended  for  comparison  with  the  flight-measured  ratings 
in  order  to  examine  possible  effects  on  ratings  due  to  motion  or  to 
task  differences.  His  subjects  were  free  to  select  control  stick 
gearing  (i.e.  controlled  clement  gain)  over  a range  of  one  to  ten  Ib/deg. 
For  purposes  of  establishing  a calibration  between  the  proposed  pilot 
rating  metric  and  pilot  rating  this  procedure  is  probably  ade- 
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quace  for  ensuring  that  the  experimental  rating  data  are  not  contam- 
inated with  effects  due  to  nonoptimum  controlled  element  gain.  A 
force  stick  was  used. 

Arnold's  subjects  selected  a random  w-gust  intensity  of  10  ft/sec 
rms  value.  The  spectral  shape  used  was  a first-order  approximation  to 
the  Dryden  gust  model  of  reference  [2].  This  rather  high  intensity 
turbulence  level  was  selected  on  the  basis  that  it  provided  a realistic 
and  natural  pitch  tracking  task  similar  to  actual  flight  conditions. 

Table  2 is  a listing  of  stability  derivatives  and  various  short- 
period  parameters  as  tested  in  the  Arnold  experiment.  These  data  had 
already  been  analyzed  by  Major  James  Dillow  of  the  Air  Force  Institute 
of  Technology.  He  used  a modified  version  of  the  Kleinman  model  which 
allowed  the  incorporation  of  the  display  threshold  and  selected  a cost 
functional  and  its  weights  to  yield  a close  match  between  model-pre- 
dicted and  measured  closed  loop  tracking  performance  (viz.,  mean  square 
pitch  attitude  error).  This  work,  recently  published  (reference  25), 
and  the  associated  computer  programs  were  made  available  to  this  author 
by  Major  Dillow. 

The  Kleinman-Dillow  model  (subsequently  referred  to  as  the  K-D 
model)  departs  from  the  conventional  Kleinman  model  (figure  2)  in 
that  display  or  physiological  thresholds  are  incorporated  into  the  rate 
and  position  feedback  paths  just  prior  to  the  Kalman  filter.  Each  is 
included  in  the  model  as  a gain  term  (which,  for  random  inputs,  is  the 
describing  function  representation  for  a threshold  nonlinearity)  followed 
by  an  injection  of  remnant  to  simulate  the  nonlinear  portion  of  the 
threshold's  response.  The  threshold  gain  and  the  signal  level  of  the 
threshold  remnant  are  adjusted  iteratively,  during  the  solution  of  the 
optimal  control  problem,  to  ensure  that  the  threshold's  input  and  output 
signal  levels  are  consistent  with  the  choice  of  describing  function. 

The  cost  functional  used  in  the  K-D  model  consists  of  the  weighted  sums 
of  the  variances  of  state  variables  as  they  are  perceived  by  the  human 
operator.  This  is  a conceptual  departure  from  the  original  Kleinman 
model  (illustrated  on  figure  2). 

Another  unique  feature  of  the  K-D  model  is  its  incorporation  of 
a calculation  for  the  equivalent  Kalman  filter  gain  in  each  feedback 
channel.  This  is  done  in  ad  hoc  fashion,  following  convergence  of  the 
routine  for  solving  the  matrix  Riccati  equation,  by  computing  the  ratio 
of  root-mean-square  signal  levels  for  the  estimated  and  actual  variables. 
This,  in  essence,  is  a random  input  describing  function  representation 
for  the  Kalman  filter. 

The  K-D  model  for  the  Arnold  pitch  attitude  tracking  experiment, 
following  its  convergence  to  the  optimal  control  solution,  can  be 
approximated  as  shown  in  figure  23.  Tlie  predictor  gain  is  unity  in  both 
channels.  The  remnant  due  to  rate  and  position  tliresliolds  and  to  motor 
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noise  has  been  lumped  into  an  equivalent  observation  noise  injection 
process.  Both  the  time  delay  and  the  predictor  have  been  omitted 
from  figure  23;  their  effects  tend  to  be  se 1 f-cancel ing . Further, 
delays  will  have  no  effect  on  the  use  of  the  K-1)  model  for  estima- 
tion of  the  pilot  rating  metric.  The  reader  should  compare  the  model 
of  figure  23  with  that  of  figure  10  (which  is  a specialization  of 
figure  9).  They  are  the  same,  except  for  their  treatments  of  neuro- 
muscular system  dynamics,  provi^  d that  the  command  input  of  figure  10 
is  transformed  into  the  vehicle  disturb.ince  of  figure  23  - - an  easy 
matter.  The  cost  functional  weights  of  70  and  7 for  mean-squared 
pitch  attitude  and  mean-squared  pitch  attitude  rate,  respectively,  had 
been  previously  determined  by  Oil  low  to  yield  a global  match  of  model- 
predicted  and  measured  0^  and  (T<^  . jit  should  .also  be  noted  that 
was  a feedback  variable  to  the  state  predictor  in  the  K-D  model.  How- 
ever, it  was  not  controlled  in  closed  loop  fashion.)  The  disturbance 
was  identical  to  that  used  in  the  Arnold  experiment  - - i.e., 
with  a first-order  approximation  to  the  Oryden  spectra. 


Table  3 is  a summary  of  K-D  model  parameters  for  the  Arnold 
configurations  of  Table  2.  Both  experimental  and  K-D  model-predicted 
values  for  and  fT©  are  shown  for  the  reader's  assessment  of  the 

quality  of  the  model's  match  of  closed  loop  performance.  The  average 
pilot  opinion  ratings  (FOR)  obtained  from  Arnold's  experiment  are  also 
listed;  these  are  the  familiar  Cooper-Harper  rating  scale  values.  The 
pilot  rating  metric  (from  equation  19)  is  computed  using  the  model- 

predicted  gains  (with  Kp»  l ) and  the  experimental  values  for  ; 

the  results  are  shown  for  each  of  Arnold's  cases  in  Table  3. 


The  calculation  of  the  rate  feedback  activity  parameter  de- 

serves further  comment  since  it  illustrates  a problem  that  arises  in  the 
application  of  state-of-the-art  pilot  models  for  the  calculation  of 
signal  levels  internal  to  the  pilot.  It  has  already  been  indicated  on 
these  pages  that  an  ambiguity  exists  in  the  determination,  by  the 
application  of  theory,  of  the  pilot  model  gains;  viz.,  variations  in 
control  effectiveness  will  produce  counter-balancing  variations  in 
pilot  gains.  It  is  therefore  necessary  that  the  gain  terms  be  nor- 
malized with  respect  to  a selected  value  of  control  effectiveness. 

This  value  should  be  optimum  with  respect  to  FOR  for  at  least  one 
controlled  element  configuration;  otherwise  it  is  arbitrary.  If  the 
predicted  is  not  normalized  with  respect  to  control  system  gain, 

then  systematic  error  will  be  Introduced  in  attempts  to  correlate  FOR 
data  from  different  sources  or  to  predic^  FOR  using  the  present 
theory.  The  value  =-14.54  rad/sec  was  selected  from  Arnold's 

data  as  the  normalizing  control  effectiveness  for  all  data  discussed 
in  this  report.  This  normalizing  contrivance  is  necessary  due  to 
shortcomings  in  available  models  for  pilot  dynamics.  It  will  no  longer 
be  required  when  can  be  directly  estimated  in  a fashion  that 

accounts  for  the  effects  on  FOR  of  controlled  element  gain  and  neuro- 


58 


muscular  system  dynamics.  It  should  be  understood  tliat  these  remarks 
are  not  meant  to  imply  that  a universal  optimum  control  effectiveness 
e.xists.  This  is  definitely  not  true  in  actual  flight  due  to  the  con- 
flicting requirements  posed  by  the  Joint  control  of  pitch  attitude  and 
normal  acceleration.  The  reader  should  also  note  the  remark  at  the 
close  of  the  introduction  to  this  report  about  the  nomenclature  used 
here  for  defining  control  effectiveness. 

The  variation  of  measured,  average  pilot  opinion  rating  (FOR)  with 
the  predicted  value  of  the  proposed  rating  metric  from  Table  3 is 

shown  on  figure  24.  The  nominal  curve  is  an  eyeball  fit  which  weights 
the  better  FOR  conditions  more  heavily  than  the  poor  ones.  The 
rationale  for  this  is  provided  by  the  McDonnell  study  (reference  17) 
which  concludes  that  the  number  of  experimental  trials  required  to 
obtain  accurate  estimates  of  average  pilot  opinion  ratings  increases 
rapidly  with  increasing  pilot  ratings.  Thus,  many  more  trials  are  re- 
quired to  accurately  determine  the  average  FOR  for  Arnold's  worst-case 
configurations  than  were  actually  performed.  The  nominal  curve  of 
figure  24  is  bounded  by  curves  of  plus  and  minus  one-half  rating  unit. 

It  can  be  seen  that  the  fit  between  FOR  and  0^^  is  remarkably  good.  All 
fourteen  data  cases  are  nominally  contained  within  the  + one-half  unit 
range.  As  a matter  of  interest,  correlates  FOR  better  than  Arnold's 

metric  based  on  the  minimum  pilot  rating  concept  (i.e.,  Anderson's 
Faper  Filot  scheme).  Based  on  a trial  and  error  approach,  Arnold 
selected  the  pilot  rating  functional 

POR  = S.eC'e  +0.43(7^  +0.43\  +1.0  (El) 

where  "T^  is  tlie  ) ead  time  constant  in  the  servo  model  for  pilot  dynamics. 
The  Faper  Filot  computer  program  used  by  Arnold  optimized  the  choice 
of  pilot  model  parameters  to  minimize  this  functional.  The  pilot  ratings 
predicted  by  this  process  are  compared  in  figure  25  with  the  averaged 
ratings  obtained  from  the  simulation;  figure  25  is  a direct  reproduction 
of  Arnold's  figure  16.  The  functional  together  with  the  Paper  Pilot 
program  is  seen  from  figure  25  to  correlate  FOR  to  + one  rating  unit, 
nominally. 

The  Arnold  data  as  analyzed  with  the  K-D  model  and  plotted  in 
figure  24  confirms  the  hypothesized  variation  of  FOR  with  the  metric 

(figure  22).  According  to  the  hypotheses  of  this  report  the  curve 
of  figure  24  has  a basic  physical  connotation;  the  existence  of  a unique 
relation  between  FOR  and  should  not  be  regarded  as  empirical  but 

is,  by  hypothesis,  a basic  physical  property  of  human  subjective  response. 
However,  the  quantitative  calibrat ion  of  FOR  vs.O^^  is  based  on  the  use 
of  empirical  data  (i.e.,  Arnold's)  and  a control  theoretic  provided  by 
the  Kleinman  model  for  pilot  dynamics.  Errors  in  either  the  data  or  the 
pilot  model  will  affect  the  FOR  vs.  calibration.  It  is  plausible 

to  suspect  that  the  FOR  calibration  will  depend  upon  pilot  background. 


It  is  not  witliin  the  state-of-the-art  to  predict  pilot  biases  of 
this  nature;  it  is  this  author's  belief,  however,  that  the  use  o f 
as  a diagnostic  tool  will  permit  the  identification  of  pilot  bias 
to  a degree  that  has  not  been  possible  heretofore.  According  to 
McDonnell's  study  we  must  also  expect  random  variations  in  FOR  among 
a fixed  pilot  population;  the  degree  of  this  randomness  is  related 
to  task  difficulty.  For  that  reason,  the  vs.  FOR  relation  of 

figure  24  must  be  regarded  as  an  average  correlation. 

The  FOR-  curve  of  figure  24  is  conceivably  a suitable 

tool  for  the  prediction  of  FOR  in  any  single  loop  tracking  task.  How- 
ever, it  is  desirable  that  its  validity  be  confirmed  with  additional 
data  sources.  Almost  no  usable  data  are  available  for  this  purpose. 

The  McDonnell  experiment  of  reference  17  generated  data  that 
are  of  limited  use.  His  experiment  was  similar  to  Arnold's,  but  not 
nearly  as  much  data  were  collected.  No  measures  were  made  of  0^  and 
McDonnel  served  as  his  own  subject  for  all  his  published  data  runs  that 
are  of  potential  value  here.  His  goal  was  to  examine  relative  rating 
scale  effects.  His  data  cannot  be  used  with  the  same  degree  of  con- 
fidence as  can  Arnold's  for  validation  of  the  handling  qualities  metric. 
Despite  its  inadequacies,  the  McDonnell  data  can  be  used  to  qualita- 
tively confirm  the  relation  of  figure  24. 

The  K-D  model  was  applied  to  the  McDonnell  configurations  in  a 
manner  similar  to  that  for  the  Arnold  cases.  A computer  program  made 
available  by  Dillow  was  adapted  to  this  application.  Small  thresholds, 
representing  limits  of  visual  perception,  were  placed  in  the  pilot 
model's  rate  and  position  channels.  The  computations  of  optimal  con- 
trol gains  and  system  performance  were  made  using  the  same  cost  func- 
tional and  weights  as  were  used  for  analysis  of  the  Arnold  data. 

Further  details  of  the  system  model  may  be  found  in  reference  25. 

Controlled  element  gain  was  a parameter  in  the  McDonnell  experi- 
ment. However,  insufficient  data  were  collected  to  permit  the  iden- 
tification of  the  optimum  gain  (with  respect  to  FOR)  for  each  con- 
trolled element.  Fresent  theory  requires  that  only  those  data  runs 
conducted  with  optimum  gain  be  used  for  the  determination  of  average 
FOR  and  signal  statistics.  In  order  to  extract  as  much  information 
as  possible  from  McDonnell's  data,  all  his  FOR  data  for  a given  con- 
trolled element  and  a given  command  input  standard  deviation  were  aver- 
aged without  regard  for  controlled  element  gain.  This  will  therefore 
constitute  a source  for  systematic  error  in  the  present  analytical 
comparisons. 

According  to  present  theory,  FOR  will  be  affected  by  both  the 
system  input  intensity  and  its  spectral  distribution.  However,  use  of 
the  K-leinman  model  - - which  is  linear  - - will  not  permit  the  resol- 
ution of  effects  on  (and,  therefore,  on  FOR  correlations)  due  to 


input  bandwidtli  - - another  experimental  parameter.  McDonnell's  POK 
data  were  averaged  without  regard  lor  input  bandwidth  which  con- 
stitutes another  source  for  systematic  error  in  the  present  attempt 
to  confirm  a correlation  between  POR  and  . It  is  reasonable 

to  expect  that  for  the  low-bandwidth  inputs  used  by  McDonnell  this 
will  be  a small  effect.  It  could  be  extremely  important,  however, 
if  the  input  bandwidth  were  large  relative  to  the  closed  loop  cross- 
over frequency. 

The  R-D  model  parameters,  input  standard  deviation,  controlled 
element  dynamics,  measured  and  predicted  <Jq  , predicted  0^  and  , 

measured  servo  model  lead  time  constant  TL  , number  of  data  runs 
available  for  the  estimation  of  average  POR,  average  POR,  POR  esti- 
mated from  the  POR-  calibration  of  figure  24,  and  POR  esti- 

mated from  a Paper  Pilot  based  formula  derived  by  Arnold  (equation 
21)  are  all  shown  in  Table  4.  McDonnell's  units  for  pitch  attitude 
were  in  centimeters  of  displayed  error;  this  is  immaterial  for  the 
calculation  of  6"^%^  , however,  since  rescaling  of  the  program  vari- 

ables would  merely  rescale  the  optimal  controller  gains  from  the  K-D 
model  by  a compensating  amount.  We  may  assume,  therefore,  that 
is  in  units  of  degrees  in  Table  4 and  is  dimensionally  consistent 
with  the  Arnold  data. 

It  should  be  noted  that  the  estimates  for  0)*^  shown  in  Table  4 
for  the  final  three  cases  may  not  be  reliable.  In  each  case  only  one 
data  run  was  conducted  so  that  a reasonable  average  for  POR  cannot 
be  determined.  The  final  two  controlled  elements  (cases  12  & 13)  are 
unstable.  The  suitability  of  the  Kleinman  model  for  unstable  plants 
has  not  been  generally  confirmed.  Case  13  will  be  disregarded  since 
the  pilot  lost  control  during  the  run  (POR  = 10) , no  further  attempts 
were  recorded,  and  the  instability  is  not  so  severe  as  to  preclude 
manual  control  with  practice. 

The  variation  of  the  predicted  with  average  POR  is  shown 

on  figure  26  for  the  data  of  Table  4.  The  agreement  between  the 
McDonnell  and  the  Arnold  data  is  surprisingly  good  considering  the 
experimental  and  analytical  uncertainties  noted  above.  It  is  clear 
that  is  a useful  metric  for  the  correlation  of  McDonnell's  rating 

data.  These  data  appear  to  support  the  hypothesis  that  the  variation 
of  POR  with  shown  in  figure  24  can  be  used  as  a predictor  for 

POR  provided  that  a satisfactory  model  exists  for  the  estimation  of  <3^^  . 

Reference  20  examines  the  pitch  attitude  tracking  data  of 
Onstott,  et  al  (reference  21)  with  the  Paper  Pilot  method.  The 
reference  21  experiment  included  a moving  base  simulation  of  pitch 
attitude  tracking  in  turbulence.  Measurements  of  <T<^  were  not  recorded 
nor  was  control  effectiveness  optimized  with  respect  to  pilot  opinion  for 
each  conf igurat ion  tested.  Thus,  the  reference  21  data  base  is  too 
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incomplete  to  warrant  detailed  treatment  here.  Nevertheless,  it  can  pro- 
vide a limited  sample  for  comparison  with  figure  24. 


Johnson,  in  reference  20,  estimated  servo  model  parameters  for 
the  Onstott  configurations  using  the  Paper  Pilot  methodology  and  an 
empirical  rating  functional  derived  from  Onstott 's  data.  Of  the  35 
configurations  examined  by  Johnson  only  2 resulted  in  non-zero  estimates 
for  the  pilot's  lead  time  constant.  This  may  have  been  partly  due 
to  the  form  used  for  the  pilot  rating  functional.  Once  more,  however, 
it  should  be  recalled  that  servo  model  lead  does  not  necessarily  reflect 
rate  feedback  activity;  that  is,  there  can  be  quite  a lot  of  rate  control 
without  this  being  manifested  as  a lead  time  constant  in  the  pilot  model 
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This  remark  is  based  on  the  postulated  validity  of  the  nonlinear,  multiple 
loop  model  as  a representation  for  pilot  dynamics.  Thus,  without  more 
extensive  analysis,  only  two  of  Johnson's  35  data  sets  can  be  used  here 
for  validation  of  the  POR  metric  . Johnson's  Paper  Pilot  estimates 

and  the  POR  for  these  two  cases  are  shown  in  Table  5 together  with  the 
estimated  metric  obtained  from  the  application  of  equation  20. 

The  two  data  points  are  compared  in  figure  26  with  the  proposed  rating 
metric.  The  agreement  is  surprisingly  good  - - especially  when  one 
considers  the  uncertainties  involved  in  the  Paper  Pilot  method,  the  lack 
of  an  experimental  measurement  for  CT^  , and  the  possible  contaminating 
effects  on  pilot  ratings  of  a non-optimum  control  effectiveness. 


No  other  data  base  is  known  to  this  author  that  would  be  immediately 
suitable  for  validation  of  as  a general  metric  for  the  correlation 

or  prediction  of  pilot  opinion  ratings.  Other  data  probably  exists  but 
a major  effort  would  be  required  to  seek  it  out,  document  it,  and  verify 
its  suitability  for  present  purposes.  The  roll  tracking  data  of  Onstott, 
et  al  (reference  21)  is  one  such  set  tliat  might  be  useful.  These  data 
were  examined  by  Naylor  (reference  22)  using  the  Paper  Pilot  scheme 
to  correlate  POR.  Unfortunately,  neither  source  documents  Cp  (p  = roll 
rate),  although  this  variable  was  probably  recorded  during  the  experiment 
and  may  have  been  available  from  the  Paper  Pilot  printout.  Onstott 's 
roll  tracking  experiment  was  performed  in  a moving  base  simulator  with 
artificial  turbulence  of  various  intensities.  Control  effectiveness 
liowever,  was,  not  a parameter  in  these  experiments  and  could  be  a source 
for  systematic  error  in  pilot  opinion  ratings. 

Both  McDonnell's  and  Onstott' s limited  data  were  shown  to  correlate 
fairly  well  with  the  data  set  derived  from  Arnold's  experiment.  For  all 
these  data  (7a>a  been  shown  to  be  a very  sensitive  measure  for 

handling  qualities.  These  three  data  sets  represent  a wide  range  of 
controlled  element  dynamics  and  input  intensities.  The  Onstott  data 
were  from  a moving  base  simulation.  McDonnell's  data  were'  for  a command 
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Input.  The  pilots  used  for  the  collection  of  rating  data  had  a very 
wide  range  ot  experience.  The  control  stick  properties  were  widely 
d i f ferent . 

At  the  time  of  this  writing  there  is  no  data  available  to  this 
author  to  refute  the  validity  of  0"^^  as  a tool  for  the  prediction  of 
pilot  opinion.  Accordingly,  it  is  postulated  that  figure  24  may  be 
used  to  predict  pilot  opinion  ratings  for  any  single  loop  control  task 
for  which  a reasonable  estimate  can  be  made  of  or,  in  general,  0^,^  ; 

it  must  be  understood  that  the  predicted  FOR  is  valid  only  to  the 
extent  chat  the  feel  system  characteristics  are  optimized  with  respect 
to  FOR. 


E.  RATING  DIFFERENCES:  IN-FLIGHT  VS.  FIXED-BASE 

Arnold  compared  his  fixed  base  simulation  measurements  of  FOR  with 
Che  Neal-Smith  flight  test  measurements  for  the  identical  aircraft 
dynamic  configurations.  His  final  comparison  is  repeated  for  convenience 
in  figure  27.  The  squares  represent  the  average  pilot  ratings;  the 
rating  r.anges  are  also  shown.  The  configuration  number  is  shown  inside 
the  squ.ire  and  corresponds  to  the  data  of  Table  2. 

Tile  comparison  is  generally  quite  good.  Three  cases,  however, 
differed  enough  to  prompt  comment  by  Arnold  (reference  18).  He  noted 
Chat  configurations  9,  10  and  11  were  significantly  down-rated  in  flight 
whereas  each  had  been  rated  as  good-to-excellent  in  the  simulation.  He 
attributed  tliis  discrepancy  to  task  differences  between  tiie  two 
experiments.  The  flight  test  rating  was  based  on  the  aircraft's 
behavior  during  tracking  tasks  (IFR  and  VFR)  and  simulated  air  combat 
maneuvers  of  both  a gross  and  precision  type.  The  simulation  rating 
was  based  only  on  precision  tracking  without  motion  cues. 

These  three  configurations  (i.e.,  9,  10  and  11)  are  re-examined 
in  this  article  to  see  whether  another  explanation  might  not  exist  for  the 
flight  vs.  simulator  FOR  differences. 

The  approach  taken  was  to  re-apply  the  K1 einman-Di 11 ow  model  to 
each  of  the  three  errant  configurations;  the  K-D  model,  however,  was 
suitably  parameterized  to  simulate  tlie  Neal-Smith  flight  test  conditions, 
rather  than  the  fixed-base  simulation,  insofar  as  this  was  possible.  It 
was  hypothesized  that  - - at  least  for  the  tracking  experiments  - - the 
major  parametric  change  required  of  the  K-D  model  to  re-crea*e  the  flight 
tests  was  to  remove  the  large  display  threshold  effect  from  the  q and  © 
feedback  paths  that  had  been  necessitated  by  Arnold's  display.  There 
were  no  knowii  significant  visual  tliresholds  in  the  Neal-Smith  tests  (other 
than  the  unavoidable  physiological  limitations  which  are  negligible 
for  this  analysis).  The  same  gust  spectrum  and  level  were  used  as  for 


jVrnold's  experiment  and  for  tlie  previous  analysis  of  his  data  with  the 
K-D  model  - - i.e.  a first-order  approximation  to  the  Dryden  spectra  with 
an  rms  i.alue  CT^.  = 10  f/s.  The  K-D  model  was  further  modified  to  include 
feedback  control  of  the  motion  variables  © , © and  djp  - - the  normal 

acceleration  at  the  pilot's  station.  It  was  hoped  that  this  would  be 
sufficient  to  account  for  any  handling  quality  effects  due  to  aircraft 
motion  during  the  actual  flight  tests.  The  weighting  on  the  control 
of  e and  q was  the  same  as  previously  used  for  Arnold's  data.  By  trial 
and  error,  it  was  determined  that  the  results  are  insensitive  to  the 
weights  on  0 , e and  Ojp  . Basically,  these  motion  feedbacks  only 
affect  the  quality  of  the  state  variable  estimation  via  the  Kalman  filter 
and  the  predictor  in  the  K-D  model.  This  quality,  however,  is  already 
high  and  leaves  little  room  for  improvement.  The  resulting  parameters 
predicted  by  the  K-D  model  for  these  three  configurations  are  listed  in 
Table  6.  The  predicted  value  for  is  also  shown.  This  value  was 

used  to  estimate  the  flight-test  POR  from  the  calibration  curve  of 
figure  24.  This  estimate  is  also  shown  in  Table  6 together  with  the  Neal- 
Smith  and  Arnold  values. 

Comparison  of  the  POR  values  of  Table  6 indicates  that  the  model 
predicted  values  are  in  substantially  better  agreement  with  the  flight- 
test  values  for  cases  9,  10  and  11  than  are  the  simulator  results.  It 
was  determined  by  a separate  investigation  to  be  discussed  in  Section  V 
that  the  motion  feedbacks  have  no  substantial  effect  on  the  POR  pre- 
diction shown  in  Table  6.  It  is,  in  fact,  obvious  that  the  good  correlation 
between  predicted  and  flight-test  measured  POR  for  cases  9,  10  and  11 
is  entirely  due  to  the  removal  of  effects  from  the  K-D  model  of  Arnold's 
display  threshold.  Compare  the  parameters  of  Tables  3 and  6 for  these 
cases.  With  Arnold's  display  the  display  gain  is  very  small  or  zero; 
it  is  1.0  for  the  flight-test  parameterization  of  the  K-D  model.  Without 
the  threshold  effect  the  Kalman  filter  gain  is  much  larger.  The  net 
effect  due  to  removal  from  the  K-D  model  of  the  display  threshold  is 
to  increase  the  estimated  which,  from  figure  24,  will  increase  the 

predicted  rating  for  the  flight  test  condition. 

The  above  procedure  is  potentially  a remarkable  way  to  "adjust" 
simulator-derived  POR  to  predict  ratings  in  flight  test.  If  POR  from  a 
simulation  experiment  can  be  correlated  with  (or,  in  general , 

for  any  tracking  task) , and  if  the  pilot-vehicle  system  model  used  for 
the  prediction  of  can  be  modified  to  account  for  differences  known 

to  exist  in  flight,  then  the  predicted  for  flight  will  correlate 

the  flight  test  POR  in  exactly  the  same  way  as  the  POR-  correlation 

from  the  simulation.  This  procedure  has  the  appearance  of  a "boot- 
strap" operation.  It  really  isn't,  however;  its  successful  application 
depends  only  upon  the  validity  of  (or  ) as  a physiological 

trigger  for  POR. 

From  the  above  analysis  it  is  concluded  that  the  major  source  of 
the  differences  between  Arnold's  fixed-base  simulation  and  the  Neal- 


64 


I 


f 


Smith  flight  tests  was  tlie  display  threshold  in  the  simulation.  Tliis 
would  be  expected  to  have  its  major  effect  on  the  very  best  of  Arnold's 
configurations;  these  are  cases  1,  6,  9,  10  and  11  which  are  all  Level  1 
(FOR  i 3.5  ).  For  these,  is  small  with  q often  buried  in  the 

threshold  region.  This  can  be  seen  from  the  K-D  parameters  of  Table  3; 
for  these  cases  the  display  describing  function  is  very  small. 

Observe  that,  from  figure  27,  these  cases  are  all  rated  more  poorly 
in  flight  than  in  the  simulation.  In  fact,  these  are  the  only  cases 
falling  to  the  right  of  the  line  of  perfect  agreement  in  figure  27.  It 
should  be  completely  obvious  that  there  will  be  only  a small  threshold 
effect  on  the  other  cases;  in  other  words,  the  removal  of  the  display 
threshold  from  the  K-D  model  and  the  calibration  curve  of  figure  24 
will  permit  the  correlation  of  the  Neal-Smith  flight  test  data  with 
to  within  about  + 1 rating  unit  except  for  case  5.  Case  5 was  the  most 
poorly  rated  case  tested  by  Arnold.  It  is  possible  that  the  in-flight 
motion  cues  benefit  the  handling  qualities  of  this  configuration.  It  is 
perhaps  noteworthy  that  all  of  Arnold's  Level  2 and  3 cases  were  rated 
better  in  the  flight  tests. 

Another  interesting  point  to  be  noted  is  that  the  FOR  predictions 
were  based  only  on  tracking  considerations,  yet  they  are  ia  remarkably 
good  agreement  with  flight  test  values.  The  flight  tests  involved  many 
open  and  closed  loop  flight  control  tasks  related  to  air  combat  with 
fighter-type  aircraft.  The  ratings  obtained  are  overall  ratings  which, 
in  some  ill-defined  manner,  are  supposed  to  rate  the  global  qualities 
of  the  aircraft  for  use  in  air  combat  tasks.  This  comparison  therefore 
suggests  two  interesting  corollaries: 

(1)  The  pilot's  overall  impressions  of  an  aircraft  in  an  air 
combat  environment  are  very  much  dependent  upon  considerations 
that  are  Important  to  closed  loop  tracking. 

(2)  Attitude-only  control  is  the  central  problem  to  the  deter- 
mination of  an  aircraft's  overall  handling  qualities. 

The  evaluation  pilots  in  the  CALSPAN  flight  tests  were  free  to 
select  optimum  control  stick  gearing  for  tasks  involving  both  attitude 
tracking  and  gross  maneuvering.  In  general,  the  stick  force  - deflection 
sensitivity  requirements  differ  for  each;  viz. , lighter  stick  forces 
for  tracking  and  heavier  forces  for  manuevering.  The  pilots  tended 
to  downrate  the  aircraft's  handling  qualities  when  the  optimum  stick 
sensitivity  requirements  for  tracking  and  maneuvering  greatly  differed 
(reference  19).  This  is  an  excellent  potential  reason  to  explain  the 
differences  between  the  predicted  in-flight  FOR,  above,  and  the  flight- 
test  values. 

I'hi're  is,  at  this  writing,  no  basis  for  believing  that  either  task 
! i 1 I i renres  or  motion  cues  are  responsible  for  the  differences  shown  in 
•ic'ire  27  between  fixed-base  and  flight-test  measured  FOR. 
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i'.  KATINC  I'RKUICTION  IN  Ml'LTII'Lt'  1,001’  IRACKINO 

The  original  scope  of  this  study  was  restricted  to  single  loop 
tracking  tasks  representative  of  aircraft  attitude  control.  Tlie  lack 
of  suitable  data  has  prevented  definitive  validation  of  as  a metric 

for  pilot  opinion  rating  in  single  loop  tracking,  however.  In  an  effort 
to  e,xtend  tlie  available  data  base  the  simulation  data  of  Miller  6.  Vinje 
(reference  21)  were  examined  vis-a-vis  present  theory.  They  simulated 
precision  hovering  control  (a  multiple  loop  task)  of  a multitude  of  VTOl, 
aircraft  conf igurat ions.  Only  their  longitudinal  data  are  considered 
liere.  A liigh-f idelity  contact  analog  simulation  of  VKK  flight  was  used 
for  the  pilot's  display.  Their  work  is  valuable  mainly  because  it  is  one 
of  the  few  experimental  sources  for  which  full  documentation  is  available 
for  pilot  opinion  ratings,  aircraft  dynamics,  and  suitable  closed  loop 
performance  measures.  This  was  the  source  used  by  Anderson  in  his 
development  of  the  Paper  Pilot  methodology  of  reference  3. 

The  Miller-Vinje  precision  hover  configurations  had  already  been 
analyzed  by  Major  .lames  Dillow  of  the  Air  Force  Institute  of  Technology, 
who  used  the  Kleinman  model  to  match  the  experimental  performance 
measures.  These  unpublished  results  were  made  available  to  this  author 
for  use  in  this  report.  Table  7 summarizes  the  match  achieved  by 
Dillow  of  the  measured  rms  performance  values.  The  Kleinman  model 
parameters  determined  by  Dillow  are  used  here  to  continue  the  search 
for  a predictive  metric  for  pilot  opinion  rating. 

Miller  and  Vinje  used  the  older  Cooper  scale  for  the  collection 
of  their  pilot  opinion  rating  data.  The  conversion  of  these  ratings 
to  the  Cooper-Harper  scale  is  shown  in  Table  8.  The  conversion 
equations  are  those  suggested  by  .McDonnell  (reference  17)  from  his 
study  of  rating  scales.  These  estimated  Cooper-Harper  ratings  will  be 
used  in  further  discussions  of  the  Miller-Vinje  data. 

Di! low's  optimal  control  model  for  this  experiment  used  feedback 
control  of  error  in  longitudinal  position  x,  longitudinal  velocity 
oc  = >1  , longitudinal  acceleration  u , pitch  attitude  B , and  pitch 

attitude  rate  ‘}.=  ® . The  analysis  was  similar  to  that  for  the  Arnold 
experiment  - - previously  discussed  - - and  will  not  be  discussed  here 
in  detail.  Only  the  principal  results  are  relevant  to  the  present 
discussion.  Table  9 summarizes  the  Kleinman  model's  prediction  of 
optimal  controller  gains  and  equivalent  Kalman  filter  gains.  Thresholds 
were  included  in  lU  How's  version  of  the  Kleinman  model  to  simulate 
physiological  limits  of  the  visual  senses.  These  were  too  small  to  be 
of  significance  and  their  effects  are  ignored  here  (i.e.  the  threshold 
describing  functions  were  all  = 1.0).  Table  10  summarizes  the  cross- 
correlations of  various  signal  products  predicted  by  the  K1 einman-Dillow 
model . 
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It  should  he  noted.^lhat  the  Mi  1 ler-V  in  je  units  for  control  effect- 
iveness Mjg  are  rud/s"  per  inch  of  control  stick  deflection.  The 
control  stick's  effective  length  is  not  given  in  reference  23  but  can 
be  expected  to  be  about  24  inches  for  a floor-mounted  cyclic  control. 

Mult ipl icat ion.^o f the  Miller-Vinje  ^Se  ^>y  24  will  yield  an  Mfig  in 
units.^of  rad/s“  which  is  consistent  with  the  Arnold  units.  In  units  of 
rad/s“  the  Miller-Vinje  magnitudes  arc  typically  about  equal  to 

the  values  used  by  Arnold.  This  isn't  too  surprising  since  the  hover 
task  is  basically  one  of  attitude  control  (as  in  Arnold's  experiment) 
and  the  evaluation  pilots  were  allowed  to  optimize  the  control  sensitivity 
for  each  data  run  (also  as  in  Arnold's  experiment).  The  Miller-Vinje 
values  for  were  used  for  the  exercise  of  the  K-D  program.  The 

resulting  optimal  controller  gains  must  therefore  be  normalized  by  the 
factor  Mjg/14.54  to  compare  with  previous  estimates.  The  units  oi 
Mje  ‘ite  irrelevant  to  this  normalization.  The  normalized  pilot  rating 
metric  , however,  will  have  units  of  degrees. 

Table  11  lists  the  estimated,  normalized  pitch  attitude  rate  loop 
activity  metric  for  Che  Miller-Vinje  precision  hover  cases.  The 

metric  is  calculated  according  to  equation  19  with  both  ^ set  to 
unity.  The  measured  values  Oj  (from  Table  7)  and  predicted  gains 
(from  Table  9)  are  used  for  the  calculation.  Table  11  also  shows  the 
estimated  u-loop  activity  metric  (7^^  ; this  parameter  is  defined  anal- 
ogously to  with  u substituted  for  q.  It  is  intended  to  represent 

the  activity  in  the  rate  of  position  (i.e.  speed)  control  feedback  loop. 
Also  shown  is  a metric  defined  as  follows: 


This  metric  represents  the  value  of  a signal  /3k  = /3^  ; it  is,  in 

effect,  a measure  of  total  feedback  activity  for  the  control  of  system 
rates.  In  this  context,  the  term  "rate"  is  expanded  to  include  the 
first  derivative  of  all  attitude  and  position  variables  that  are  con- 
trolled in  closed  loop  fashion.  The  variations  of  and  with 

POR  are  show^n  in  figure  28  where  they  are  also  compared  with  the 
corresponding  variation  estimated  from  the  Arnold  data  (figure  24). 

It  is  interesting  that  the  values  estimated  for  the  Miller- 

Vinje  experiment  are  asymptotic  to  the  Arnold  values  as  POR  approaches 
the  Level  1 region.  This  suggests  the  following: 

(1)  Within  the  Level  1 region,  POR  is  primarily  a function  of 
attitude  control  behavior. 

(2)  The  variation  of  just  <0)?^  with  POR  can  be  used  as 

a sufncien^  c r i t e r i on  for  the  spec  i f ica  t ion  of  Level  1 
flying  qualities  boundaries  even  though  the  pilot  con- 
trolled several  other  variables. 
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It  is  tempting  to  accept  the  generality  of  these  observations;  both 
are  intuitively  acceptable  and  provide  a rational  basis  for  the 
widely-held  opinion  that  good  attitude  control  is  sufficient  for 
good  flying  qualities,  regardless  of  mission  or  task  specifics. 

The  Kleinman  model  for  the  Miller-Vinje  simulation  is  structurally 
similar  to  the  single  loop  model  of  figure  2.  It  has  5 feedback  loops 
corresponding  to  u,  u , x , ^ 0 . It  was  anticipated  that  the 

proposed  single  loop  pilot  rating  metric  could  be  extended  to 

multiple  loop  tracking  control  by  defining  the  appropriate  "rate"  signal 
X to  be  some  function  of  the  rates  of  position  or  attitude  variables 
which,  for  the  Miller-Vinje  data,  would  be  u and  q [As  an  aside  it  should 
be  noted  that  the  K-D  model  indicated  that  the  acceleration  feedback 
ih  was  not  of  first-order  importance  in  establishing  closed  loop  sys- 
tem performance  or  dynamic  properties.  For  that  reason,  its  effects 
are  ignored  in  this  analysis].  The  two  most  obvious  functional  re- 
lations between  the  feedback  signal  rates  in  the  u and  q channels  and 
a potential  FOR  metric  are 

1.  0}i^  j FOR  effects  due  to  attitude  and  positional 

control  are  additive,  and 

2.  ■*  fi>^  with  given  by  equation  22. 

For  the  Miller-Vinje  data  there  is  no  significant  difference  between 
these  two  metrics;  the  cross-correlation  between  q and  u is  simply 
too  small.  Only  the  value  from  equation  22  is  shown  in  figure  28. 

If  the  proposed  physical  theory  for  the  prediction  of  pilot 
opinion  rating  is  correct  then  there  is  a point  within  the  central 
nervous  system  at  which  some  measure  of  nerve  activity  will  correlate 
one-to-one  with  FOR.  Once  the  basic  relationship  between  this  metric 
and  FOR  has  been  established  for  one  tracking  task,  the  relation  should 
apply  for  all  tracking  tasks.  Thus,  if  present  theory  is  correct,  the 
FOR  metric  *^he  Miller-Vinje  multiple  loop  tracking  data  for 

a hovering  VTOL  should  be  quantitatively  related  to  FOR  according  to  the 
FOR-  relation  derived  from  Arnold's  data  for  attitude  control  of 

fighter-type  aircraft. 

From  figure  28  it  is  apparent  that  0^^  and  the  two  measures  for 

above,  do  not  generally  match  the  Arnold  curve  except  in  the  Level  1 
region  where  is  in  excellent  agreement  between  the  two  data  sets. 

There  are  three  possible  explanations  for  failure  to  achieve  the  expected 
correlation : 

1.  The  present  theory  for  FOR  prediction  is  wrong. 

2.  Either  the  Arnold  or  the  Miller-Vinje  data  bases,  or  both, 
are  faulty. 
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3.  The  prediction  of  is  incorrect  due  to: 

a.  use  of  the  n/rong  definition  for  , or 

b.  use  of  a faulty  model  for  pilot  dynamics. 

The  theory  proposed  in  this  report  for  the  understanding  and  prediction 
of  POR  in  tracking  tasks  is  physical,  not  empirical.  Tills,  together 
with  its  striking  success  in  correlating  available  single  loop  POR  data, 
indicates  that  the  first  possibility  above  should  be  dismissed  - - 
at  least  until  it  receives  a fair  test.  It  is  the  author's  opinion  that 
the  Arnold  data  are  of  high  quality.  The  Milier-Vinje  data  suffer  from 
two  points:  Miller  h Vlnje  were  their  own  evaluation  pilots,  which  is 

a questionable  procedure;  their  pilot  ratings  were  obtained  with  the 
use  of  the  Cooper  scale.  Nevertheless,  both  data  sets  seem  credible; 
the  second  possible  explanation  for  the  POR  metric  failure  is  also 
discounted.  Possibility  3a  can't  be  evaluated.  Possibility  3b  remains 
a very  plausible  explanation,  however. 

The  search  for  a unified  model  for  pilot  dynamics,  described  in 
Sections  II  and  III,  led  to  the  proposition  that  a mode-switching  model 
might  be  consistent  with  the  available  data  base  for  pilot  dynamics 
and  be  physically  acceptable.  A mode-switching  model  such  as  that  shown 
genetically  in  figure  9 could  conceivably  yield  a candidate  "rate" 
signal  equal  to  either  °r  , depending  on 

which  (if  either)  variable  was  being  controlled  at  the  measurement 
time  [ and  are  the  equivalent  pilot  gains  in  a mode-switching 

model  between  q,  u and  /2>  ].  This  situation  is  depicted  on  figure  29. 

If  a switching  model  is  physically  appropriate  then  it  is  clear  that 

use  of  the  Kleinman  model  or  the  servo  model  (both  of  which  are  continuous 

in  all  feedback  paths)  could  lead  to  gross  errors  in  the  estimation  of 

and  and,  hence,  . Specifically,  the  values  and 

from  an  intermittent  control  model  could  be  considerably  larger 
than  the  corresponding  Kleinman  model  gains.  It  is  intuitively  reasonable 
to  suspect  that  the  effects  of  mode  switching  would  be  least  apparent 
for  Level  1 aircraft  dynamics.  For  these,  attitude  control  would  be 
expected  to  dominate  the  calculation  of  via  a switching  model  for 

pilot  dynamics,  and  might  be  a reasonable  approximation. 

Conversely,  switching  should  have  a very  significant  effect  on  the  rate 
gain  calculations  for  the  poorer  configurations. 

It  is  tentatively  hypothesized  that  the  Mlller-Vinje  POR  data  could 
be  shown  to  satisfy  the  POR-  variation  derived  from  Arnold's  single 

loop  data  if  a mode-switching  model  for  the  human  pilot  were  available 
for  the  estimation  of  . There  is  no  reason  to  believe  this  is 

not  true.  In  any  event  as  calculated  from  and  above 

is  seen  to  be  a reasonably  consistent  and  sensitive  metric  for  the 
pilot  opinion  rating  data  of  Miller  and  Vinje.  It  is  quantitatively 
consistent  with  the  Arnold  single  loop  data  base  within  the  Level  1 region. 
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There  is  always  the  possibility  that  pilot  ratings  in  multiple  loop 
tracking  tasks  are  not  truly  predictable.  In  a sense,  one  might 
classify  as  a "reflex  parameter"  for  human  performance  and  work- 

load measurement  and  attribute  its  (apparent)  success  as  a predictive 
tool  for  POR  to  the  basic  "athletic"  nature  of  the  attitude  control 
task.  Multiple  loop  control  of  path  variables,  by  comparison,  casts 
the  pitot  in  a role  that  is  conceivably  more  contemplative.  His 
ratings  may  represent  a complex  synthesis  of  component  ratings  for  the 
control  of  some  or  all  feedback  quantities  that  can  be  "modeled"  only 
after-the-fact,  somewhat  in  the  nature  of  the  Paper  Pilot  approach  to 
ratings  prediction.  The  author's  position,  however,  is  that  such  a 
dismal  portent  for  the  future  of  analytical  flying  qualities  need  not  be 
accepted  until  a thorough  evaluation  has  been  made  of  switching  logic 
models  for  pilot  dynamics  in  the  manner  suggested  above. 

There  are  other  data  sets  for  multiple  loop  tracking  that  could 
conceivably  be  examined  in  the  same  manner  as  the  Miller-Vinje  data 
to  corroborate  the  POR  metric.  Notably,  these  include  the  data  of 
Teper  (reference  12)  and  Taylor  (reference  24) . Unfortunately, 
neither  data  set  is  suitable  for  present  purposes  without  a great  deal 
of  additional  analysis  after  which  serious  questions  would  still  remain 
unresolved.  Some  limited  remarks  on  these  sources  follow. 

The  Teper  data  are  from  an  experiment  intended  to  replicate  the 
Miller-Vinje  VTOL  precision  hover  simulation.  Teper  obtained  describing 
function  measures  for  pilot  dynamics  and  used  these  in  an  evaluation 
of  the  Paper  Pilot  methodology.  His  task  definition  differed  from  that 
of  Miller  & Vinje  in  that  the  evaluation  pilots  were  instructed  to  hover 
over  a spot  with  an  allowable  error  tolerance  of  + 2 feet.  The  display 
was  an  IFR  presentation  on  a CRT  that,  to  this  author,  seemed  rather 
non-physical  and  may  have  placed  unnecessary  intellectual  demands  on  the 
pilots.  Teper 's  measurements  did  include  Oj  and  0^  The  subjects 

were  permitted  to  optimize  their  choice  for  control  effectiveness  as  was 
done  in  the  Miller-Vinje  simulation;  unfortunately,  the  values  selected 
are  not  among  Teper 's  published  data.  Undoubtedly,  these  are  avail- 
able and  could  be  obtained.  However,  time  did  not  permit  the  matter 
to  be  further  pursued.  The  principal  objection  to  the  use  of  Toper's 
data,  as  published,  is  the  concern  that  his  describing  function 
measurements  and  corresponding  servo  model  parameters  will  give  severely 
biased  estimates  for  the  u-and ^ -loop  feedback  gains  required  in  the 
calculation  of  and  the  manner  previously  discussed  in  this 

report.  There  is  every  reason  to  believe,  however,  that  the  Teper  data 
are  valid.  It  would  be  interesting  to  re-analyze  this  data  with  the 
Kleinman  model.  Tf  this  were  done  the  problem  of  validity  of  a model 
for  pilot  dynamics,  continuous  in  all  feedback  paths,  would  still  remain. 

Despite  these  objections,  Teper's  data  were  used  to  investigate 
0-4  „ as  a potential  metric  for  the  correlation  and  prediction  of  pilot 
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opinion  rating.  This  was  done  as  follows: 

0/ij  = 

= *<p,\^crix 

The  results,  without  normalization  (which  wasn't  possible  without 
knowing  the  control  effectiveness  values  used),  are  shown  in  figure  30. 
There  is  an  apparent  trend  of  POR  vs.  but  the  data  quality  and 

the  Jack  of  substantial  data  at  the  poorer  POR  configurations  makes 
it  difficult  to  reach  a positive  conclusion  about  its  merits.  It  is, 
perhaps,  more  illuminating  to  examine  the  variation  of  0/ha  with  POR 
for  these  data.  This  is  shown  in  figure  31.  It  seems  evident  that 
there  is  no  apparent  correlation.  This  could  be  a result  of  Teper's 
display  and  its  possible  effects  on  piloting  strategies.  That  is, 
the  pilot  really  "flies"  the  display  - - not  the  aircraft  dynamics. 

We  can't  be  sure  (even  a posteriori)  that  pitch  attitude  control  was 
of  comparable  importance  to  system  performance  with  the  Teper  display 
as  it  apparently  was  in  the  Arnold  and  Miller-Vinje  experiments.  This 
lack  of  expected  correlation  could  also  result  from  the  indicated 
weaknesses  of  the  servo  model  for  this  application  and  from  our  in- 
ability to  normalize  for  Teper's  data. 

Taylor  (reference  2A)  used  the  data  of  reference  21  for  cor- 
relation with  Paper  Pilot  methodology.  The  reference  21  experiment, 
in  part,  consisted  of  a moving  base  simulation  of  aircraft  heading 
control  in  turbulence.  The  task  was  (apparently)  one  in  which  roll 
control  with  aileron  was  central  to  system  performance.  However, 
experimental  measurements  of  Op  , the  standard  deviation  of  roll 
rate,  were  not  published  in  either  of  references  21  or  24;  values 
estimated  by  Taylor  from  his  Paper  Pilot  analysis  are  used  here.  There 
is  justifiable  reservation  about  how  clear  any  further  computations 
involving  Cp  can  be.  As  a check,  however,  Taylor's  Paper  Pilot 
estimates  of  other  system  signal  values  are  in  good  agreement  with  his 
experimental  values  given  in  reference  21.  The  Taylor  estimates 
of  , Tl^  , K.p  > T|_  ’ 0"p  and  JJ.  were  used  by  this  author 

to  estimate 

* ^^Ar 

Ofip  - 

The  results  will  not  be  presented.  The  data  quality  permitted  by  the 
Paper  Pilot  estimates  of  servo  model  parameters,  their  use  in  estimating 
and  1 and  the  lack  of  experimental  measurements  for  (Tp  is 

simply  too  poor  to  permit  useful  resolution  of  as  a POR  metric. 

Briefly,  it  was  found  that  does  not  correlate  the  reference  21  POR 
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data.  However,  is  correlated  with  FOR  over  the  entire  data  base. 

It  is  conceivable  that  the  lack  of  correlation  between  FOR  and  was 

the  result  of  tlie  lack  of  closed  loop  control  of  iieading  V Heading  may, 
in  fact,  have  heen  controlled  in  an  intermittent  fashion. 

As  an  aside,  it  is  plausible  to  imagine  that  in  future  experiments 
of  multiple  loop  or  multiple  axis  tracking,  given  a physically  accurate 
dynamic  model  for  pilot  dynamics,  0^,^  could  be  used  to  ascertain  which 
vehicle  response  quantities  are  tracked  in  closed  loop  fashion. 

The  reference  21  data  indicate  a dramatic  difference  in  FOR  vs. 
gust  intensity  levels  for  two  of  the  evaluation  pilots.  Pilot  JBJ  was 
very  sensitive  to  increased  turbulence  intensity  (i.e.  to  Ovg  ) and 
gave  greatly  increased  ratings  for  increases  in  OVj  . Pilot  WWK  showed 
almost  no  effect  on  POR  of  . For  two  identical  configurations 

(A-7  aircraft  dynamics  with  no  SAS)  and  near-identical  CTVj  , pilot  JBJ 
gave  a POR  of  10,  whereas  pilot  WWK  rated  the  configuration  a 5. 

This  may  have  resulted  from  WWK's  considerable  experience  with 
helicopters  and  VTOL  (i.e.  "bad"  aircraft);  JBJ  had  no  similar 
experience.  It  may  also  reflect  a weakness  in  the  experimental  design 
through  failure  to  provide  satisfactory  guidelines  to  the  pilots  to 
establish  what,  specifically,  and  in  an  operational  context,  they 
were  being  asked  to  evaluate.  It  is,  for  example,  entirely  possible 
that  WTIK  rated  the  aircraft  response  to  control  in  open  loop  fashion 
while,  in  effect,  ignoring  motions  associated  with  . [This 

would  be  possible,  for  instance,  if  he  could  hear  or  feel  the  workings 
of  the  motion  system  actuators).  Similarly,  it  is  reasonable  to  suspect 
that  JBJ  rated  task  performance  as  assumed  by  the  theory  on  which  the 
metric  was  based.  If  that  is  true,  then  only  JBJ's  data  at  larger 

would  correlate  with  the  metric  (or  just  O^p  ).  Unfor- 

tunately Taylor  averaged  all  these  pilot  ratings,  thereby  making  it 
impossible  to  test  this  possibility  with  his  data. 

Given  all  these  criticisms  of  the  reference  21  data  base  and 
Taylor's  Paper  Pilot  analysis.  It  is  indeed  remarkable  that  any  cor- 
relation of  the  metric  and  POR  is  evident  as,  in  fact,  it  is. 

These  three  sources  (i.e.,  references  12,  23  & 2A)  exhaust  the 
available  data,  known  to  this  author,  that  might  be  suitable  for  rapid 
assessment  of  the  proposed  POR  theory  for  flying  qualities.  The  ten- 
tative conclusions  that  have  been  reached  are  summarized  as  follows: 

1.  The  variation  of  POR  with  derived  from  Arnold's  data  and 

shown  in  figure  24  is  generally  applicable  to  single  and  multiple  loop 
tracking  tasks  with  a single  controller  provided  that  is  replaced 

hy  signal  x is  intended  to  represent  a synthesis  of  all 

feedback  signals  that  represent  the  first  derivatives  of  path  or  attitude 
feedback  cues. 
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2.  State-of-the-art  models  for  pilot-vehicle  systems  analysis  are 

inadequate  for  the  quantitative  prediction  of  . They  can,  at  best, 

be  used  for  the  relative  estimation  of  (and,  therefore,  POR)  over 

a range  of  candidate  airframe-controller  configurations. 

3.  A physically  attractive  model  for  pilot  dynamics  that  may  permit 

accurate  predictions  of  will  incorporate  mode-switching  to  control 

each  feedback  cue  in  intermittent  fashion. 

4.  A sufficient  condition  for  the  specification  of  Level  1 flying 
qualities,  almost  without  regard  for  multiple  loop  aspects  of  control, 
is  that  the  aircraft's  attitude  control  dynamics  be  in  the  Level  1 
region.  In  general,  and  with  an  eye  cast  on  CCV  concepts,  "attitude" 
can  be  replaced  by  the  dominant,  innermost,  single  loop  variable  that 
might  arise  as  the  result  of  modern  display-controller  design  for  the 
execution  of  a specific  task  (e.g.  pipper  control  during  weapons  delivery). 


G.  COMMENTS  ON  MULTIPLE  AXIS  RATING  PREDICTION 


If  the  remarks  in  the  last  article  on  the  necessity  for  an 
intermittent  control  model  for  human  pilot  dynamics  are  accepted,  then 
it  is  reasonable  to  assume  that  the  classical  distinctions  between 
multiple  loop  and  multiple  axis  tracking  will  no  longer  apply.  That 
is,  within  the  context  of  such  a model,  the  pilot  only  does  one  thing 
at  a time.  It  therefore  makes  little  difference  in  the  theoretical 
sense  whether  he  controls  one  or  several  axes  in  single  or  multiple 
loop  fashion.  Practically,  of  course,  the  switching  logic  required  to 
construct  a successful  pilot  model  may  become  very  complicated  with 
increased  task  complexity.  If  the  correct  signal  x within  the  central 
nervous  system  can  be  deduced,  however,  then  the  calculation  of 
should  permit  the  prediction  of  pilot  ratings.  For  example,  a suitable 
"rate"  signal  for  multiple  loop  or  multiple  axis  control  might  be 
b 


X 
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where  the  ^re  pilot  model  gains  in  each  of  the  feedback  channels 

x(i).  The  variables  x(i)  represent  system  rates,  i.e.  they  are  first 
derivatives  of  path  or  attitude  feedback  cues.  The  are  zero 

except  when  the  mode  switch  is  set  to  the  control  of  x(i);  thus,  x(t-  ) 
is  a piecewise  continuous  signal  such  as  depicted  by  in  figure  29. 


Clearly,  these  remarks  are  conjectural.  They  do  follow  from  present 
theory,  however.  Considerable  research  will  be  required  to  evaluate  this 
proposal  for  the  prediction  of  multiple  axis  POR. 

Before  leaving  this  article  it  should  be  noted  that  if  this 
theory  could  be  validated  then  it  follows  immediately  that  a rule  could 
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he  devised  tor  Llie  "addition"  of  longitudinal  and  lateral -d i roc t ional 
flying  quality  requirements.  At  the  present  time,  for  example,  we  cannot 
be  certain  that  tlie  specification  of  borderline  Level  1 flying  qualities 
in  both  modes  - - separately  considered  - - will  result  in  Level  1 
evaluations  of  these  same  modes  in  flight,  where  both  must  be  controlled. 


H.  RE-EXAHINATION  OF  THE  PAPER  PILOT  CONCEPT 


It  was  previously  indicated  in  this  report  that  the  Paper  Pilot 
approach  to  pilot  rating  prediction,  as  introduced  in  reference  3, 
is  a tremendously  novel  idea.  It  relies  upon  the  use  of  a servo 
description  of  the  human  pilot  and  an  optimal  control  formalism.  The 
optimal  control  cost  functional  (defined  as  the  pilot  rating  functional), 
when  minimized  through  selection  of  the  servo  model  parameters,  yields 
a numerical  prediction  of  the  pilot's  opinion  rating  for  the  task. 

The  Achilles'  heel  of  the  Paper  Pilot  theory  is  the  a priori  re- 
quirement for  a detailed  rating  functional  description.  There  has 
been  no  physical  theory  proposed  to  assist  in  the  derivation  of  these 
functionals.  They  have  been  derived  in  all  past  work  in  a contrived 
fashion  that  relies  on  the  availability  of  large  quantities  of  POR 
data  and  on  the  employment  of  statistical  measures  to,  in  effect, 
curve-fit  these  data.  This  is  not  an  approach  that  is  generally 
acceptable  for  the  prediction  or  specification  of  flying  quality  re- 
quirements. It  could  be  acceptable,  however,  if  a physical  theory  be- 
came available  to  justify  a "universal"  rating  functional  and  if  this 
functional  were  not  restricted  by  the  nonavailability  of  handling 
qualities  data  (which  is,  in  general,  the  situation  for  those  conditions 
for  which  the  current  MIL-F-8785B  is  most  seriously  deficient). 

The  thought  seems  to  prevail  in  all  the  published  applications  of 
Paper  Pilot  methodology  that  such  a universal  rating  functional  may 
exist  and,  if  found,  would  produce  a genuinely  predictive  model  for 
POR  evaluation  in  any  conceivable  tracking  task  with  any  airframe  - 
controller  dynamic  configuration.  None  has  been  found.  In  fact, 
each  new  data  base  examined  seems  to  require  a new  rating  functional 
that  differs  significantly  from  past  ones.  Also,  it  has  been  observed 
that  relatively  small  changes  in  rating  functionals  can  produce  sig- 
nificant changes  in  predicted  POR.  Thus,  the  Paper  Pilot  method,  in 
its  present  form,  is  most  accurately  described  as  an  empirical  tool 
suitable  for  the  correlation  and  interpolation  of  existing  handling 
qualities  data.  The  successful  application  of  the  scheme  to  control 
Casks  that  involve  performance  requirements  or  airframe  - controller 
dynamics  that  differ  significantly  from  those  for  which  a rating  func- 
tional has  already  been  developed  and  validated  will  bo  highly  prob- 
1 emat ica I . 
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From  the  viewpoint  ot  the  theory  proposed  in  this  report,  it  is 
tempting  to  propose  that  a suitable  rating  functional  for  use  with 
Paper  Pilot  might  bo 

R = T,  cr^ 

where  (T^  is  the  rms  value  of  the  rate  feedback  signal.  The  mini- 
mization of  R would,  according  to  present  theory,  automatically  mini- 
mize FOR.  The  value  R predicted  by  Paper  Pilot  could  be  directly 
used  to  determine  POR  from  figure  24.  This  functional  would  strictly 
apply  to  single-loop  tracking  tasks.  It  could  be  used  for  relative 
handling  quality  evaluations  of  multiple  loop  tasks  or  ft  could  be 
generalized  in  the  manner  suggested  in  article  F of  this  section  for 
multiple  loop  predictions.  The  f”.nctional  R is  universal  in  tlie  sense 
that  it  is  independent  of  task  specifics,  dynamics,  display,  or  input. 
Unfortunately,  as  has  been  previously  indicated,  the  use  of  the  servo 
description  of  the  human  pilot  will  simply  not  permit  accurate  pre- 
diction of  the  rating  metric  0^*,^=  the  most  general 

case.  Also,  the  minimization  of  R will  not  obviously  produce  a pilot- 
vehicle  system  model  that  is  physically  acceptable  or  that  correctly 
estimates  other  measures  of  system  performance  or  dynamics. 

A GENERALIZED  PAPER  PILOT  MODEL  (TENTATIVE); 

It  is  conceivable  that  a blend  of  the  Paper  Pilot  concept  and  the 
Kleinman  model  could  produce  a method  for  pilot  rating  prediction  that 
is  consistent  with  present  theory. 

Recall  the  manner  in  which  the  baseline  variation  of  POR  with 
was  derived  from  the  Arnold  data  set.  The  Kleinman-Dil low  model  was 
used  to  minimize  the  cost  functional 

J=  7O0-e  * 7CTa^  ■*■!?.  (T^ 

P Tp  6 

where  ©p  and  are  the  perceived  attitude  and  rate  accounting  for 

the  effects  of  display  or  physiological  thresholds,  and  for  the  Kalman 
filter  model  for  signal  Identification.  The  resulting  optimal  con- 
troller gain  and  the  experimental  value  of  were  used  to  es- 
timate the  POR  metric  ^ (following  equation  19). 

This  metric  \-/as  then  correlateS  with  measured  POR  to  obtain  the  result 
shown  on  figure  24. 

This  process  could  be  modified  to  incorporate  the  Paper  Pilot  con- 
cept (viz.,  that  the  pilot  is  a self-adaptive  controller  who  minimizes 
his  own  ratings)  bv  including  the  POR  metric  in  the  cost  functional. 
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This  is  illustrated  below  for  a generalized  pitch  tracking  task: 

J-  = % 0-4  - 0-4  - R O'/  " r 0-/^ 

= <5  Oq,p 

J = WeOi;  - -t  r 0/^  + Ra/  (25) 

[Observe  that  the  * superscript  indicates  an  optimum  value;  it  is 
therefore  omitted  from  the  general  expression  for  J] . However,  J 
is  now  explicitly  dependent  on  the  feedback  gain  . It  is  not 

clear  what  theoretical  or  practical  difficulties  might  be  encountered 
in  solving  an  optimal  control  problem  of  this  form.  This  generalized 
Paper  Pilot  model  would  predict  ratings  by  using  only  the  component 
term  CT^p  from  J*,  together  with  figure  2A , used  as  a POR  cali- 
bration. 


DILLOW-PICHA  MODEL  FOR  RATING  PREDICTION: 


In  an  interesting,  recent  study  (reference  25) , Dillow  and  Picha 
attempted  to  unify  the  Paper  Pilot  concept  in  a manner  similar  to  that 
above.  They  replaced  the  servo  model  for  pilot  dynamics  with  the 
Kleinman  model  and  defined  the  cost  functional  given  in  equation  23 
to  be  the  rating  functional  required  by  the  Paper  Pilot  theory;  i.e., 
for  the  pitch  tracking  task 


They  arbitrarily  defined  the  predicted  pilot  rating  to  be  the  square 
root  of  the  minimized  rating  functional  (for  1 * POR  4 9 );  i.e. 

POR  =VT*  . These  authors  selected  the  rating  functional  weights  to 
ensure  a satisfactory  match  between  model-predicted  and  experimental 
rating  and  performance  data.  The  weighting  of  the  cost  functional 
to  fit  pilot  rating  data  and  its  definition  in  terms  of  perceived 
state  variables  represent  the  principal  points  of  departure  of  the 
Dillow-Picha  approach  from  the  usual  Kleinman  Model  or  Paper  Pilot 
application. 

Dillow's  and  Picha's  attempts  to  generalize  Paper  Pilot  methodology 
appear  to  have  been  motivated  by  two  considerations: 


1.  Considerable  artistry  is  required  to  parameterize 
model  for  pilot  dynamics  given  a description  of  the  control 
system  dynamics;  the  optimal  control  model,  by  contrast,  is 
by  many  to  be  much  more  mechanistic  to  apply  - - especially 
loop  or  multiple  axis  tasks. 


the  servo 
task  and 
considered 
for  multiple 
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2.  A universal  rating  functional,  if  one  exists,  has  eluded 
description  when  conventional  Paper  Pilot  methodology  is  employed. 

Their  ad  hoc  prediction  scheme  was  only  partly  successful,  although 
it  is  possibly  superior  to  past  versions  of  Paper  Pilot  in  its 
ability  to  unify  the  prediction  of  pilot  ratings.  Their  approach 
suffers  from  lack  of  a unifying  physical  theory.  They  note,  for 
example,  that  ...."The  weakness  of  the  scheme  described  in  this  re- 
port is  that  the  term  R<T^  in  the  quadratic  cost  function  was  con- 
sidered to  be  the  workload.  Yet  the  exact  interpretation  of  the 
product  R,  which  is  adjusted  to  yield  a .1  sec  lag  in  the  pilot  model, 
and  the  variance  of  the  control  rate  Og  , is  not  known"....  (refer- 
ence 25,  p.  113) . 

A potential  tie  exists  between  the  Dillow-Picha  work  and  the 
theory  of  this  report.  Again,  the  pitch  tracking  task  is  used  as  an 
example.  From  figure  23,  in  terms  of  perceived  variables. 
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Assume  that  the  inequality  1 » I 


is  generally  valid. 


Then 


i kCg  (Tq 


The  pilot  rating  (or  workload)  metric  proposed  in  this  report  is 
Then 

Finally,  the  "workload"  term  in  the  Dillow-Picha  rating  functional  is 
seen  to  be 


( - ) 


It  is  therefore  verified  by  present  theory  that  is  a workload 

measure  as  suggested  by  Dillow  and  Picha.  However,  present  theory 
suggests  that  this  peculia>-  term,  rather  thanVj*,  should,  when  prop- 
erly scaled,  entirely  predict  pilot  rating!  The  weight  R,  however, 
cannot  be  arbitrarily  selected  to  simulate  neuromuscular  system  dy- 
namics as  was  done.  To  see  why  this  is  so,  consider  that  by  the  above 
approximations 
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The  cost  functional  postulated  for  the  generalized  Paper  Pilot  theory 
(equation  25)  can  be  written  as 


- [r 


K^-f) 


Comparison  of  equation  26,  from  Dillow  and  Picha, 
from  the  theory  of  this  report,  indicates  that  the 
functional  is  correct  only  if 


R >>  r 


K * 


and  equation  27, 
Dillow-Picha  cost 


Reference  25  contains  insufficient  data  to  ascertain  whether  this  in- 
equality was  generally  satisfied. 


DILLOW-PICllA  VS.  PRESENT  THEORY: 

The  weightings  used  in  this  report  for  the  Arnold  pitch  attitude 
control  data  (and,  in  fact,  for  all  applications  of  the  Kleinman- 
Dillov;  model  in  this  report)  are  shown  in  figure  23  to  be 


Wg  = 70 


These  were  graciously  supplied  to  this  author  by  Dillow  as  represen- 
tative weights  for  obtaining  reasonable  correlation  between  model- 
predicted  and  measured  system  performance.  At  the  time  these  com- 
putations were  made,  however,  this  author  was  unaware  that  these 
weights  had  been  selected  by  Dillow  and  Picha  to  also  yield  a good 
correlation  between  their  predicted  POR  = -\fs*  and  Arnold's  measured 
values  (see  reference  25,  p.  53)!  Wliat  this  means  is  that,  more  by 
accident  than  by  design,  the  Paper  Pilot  modifications  proposed  by 
Dillow  and  Picha  may  be  directly  compared  with  the  results  shown  pre- 
viously in  this  report  for  ttie  Arnold  experimental  data.  That  is,  it 
is  claimed  in  this  report  that  Arnold's  POR  data  should  be  correlated 
with  the  metric  ; this  correlation  was  established  by  the  appli- 

cation of  Kleinman's  model  with  the  Dillow-Picha  cost  functional.  The 
resulting  correlation  is  shown  on  figure  24.  Dillow's  and  Picha's 
model  for  POR  prediction  says  that  POR  = -\fJ*  ; a comparison  of  tlroir 
predicted  POR  versus  the  actual  pilot  rating  is  shown  in  figure  35 
(tiiis  is  figure  19,  page  56,  of  reference  25).  The  POR  correlation 
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with  0^^  is  clearly  superior  to  that  between  actual  and  predicted 
I’OR  from  Dillow  and  I’icha.  This,  however,  is  not  a fair  comparison. 
Figure  24  is  merely  a calibration  of  the  proposed  POR  metric  and  is 
not  a POR  prediction.  A fair  comparison  would  require  that  the  0^  -POR 
calibration  curve  of  figure  24  and  the  proposed  Paper  Pilot  model* 
from  Dillow  and  Picha  both  be  used  to  predict  POR  for  an  independent 
data  source. 

This  is  fortunately  possible.  A direct,  valid  comparison  can  be 
made  for  the  McDonnell  pitch  tracking  data  of  reference  17. 

Dillow  and  Picha  used  the  same  weighted  cost  functional  for  pre- 
dicting POR  for  the  McDonnell  experiment  as  they  used  for  their  anal- 
yses of  Arnold's  data.  They  did  not  alter  the  performance  weights 
to  optimize  the  fit  between  predicted  and  actual  pilot  ratings. 

Thus,  their  results  are  a clear  indication  of  the  predictive  capa- 
bility of  their  Paper  Pilot  model;  these  are  shown  in  figure  36 
(this  is  figure  31,  p.  88,  of  reference  25).  It  is  evident  that  the 
predicted  ratings  are  in  very  poor  quantitative  agreement  with  the 
actual  POR.  In  fact,  Dillow  and  Picha  note  that  the  metric  l/2V~i* 
is  a superior  predictor  for  these  data.  They  note  that  better  agree- 
ment might  have  been  obtained  if  the  cost  functional  weights  had  been 
selected  to  optimize  the  POR  prediction  for  McDonnell's  data;  this, 
however,  would  destroy  the  potential  value  of  their  method  as  a pre- 
dictive tool  for  handling  qualities. 

All  applications  of  the  Kleinman-D il low  model  in  this  report 
were  made  with  the  same  cost  functional  (viz.  equation  26)  and  with 
the  same  weights  as  used  for  the  Arnold  data.  Thus,  the  metric  0^^ 
predicted  for  the  McDonneli  data  and  shown  on  figure  26  represents  an 
independent  prediction  of  POR  according  to  the  theory  proposed  in 
this  report.  The  calibration  curve  of  POR  vs.  , derived  for 

Arnold's  data  set,  represents  the  POR  predicted  by  this  theory,  given 
the  estimated  value  of  . It  Is  clear  that  (3)*^  accurately  corre- 

lates McDonnell's  rating  data  and  yields  a reasonable  quantitative 
prediction  of  POR. 

The  above  comparison  indicates  that  the  metric  proposed  in 

this  report  is  superior  as  a predictive  tool  to  Che  modified  Paper 
Pilot  model  proposed  by  Dillow  and  Picha.  The  real  power  of  the  metric 

(or,  in  general,  of  ) is  that  it  results  from  a physical 

theory  for  pilot  dynamics  and  subjective  response.  Thus,  a basis  has 
been  created  for  modifying  the  metric  to  accomodate  new  data  on  human 
dynamics  or  refined  models  for  human  dynamic  behavior.  This  is  not 
generally  possible  with  an  empirically-oriented  theory. 
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SL’MMi\RY: 


The  metric  (or,  in  general  ),  when  used  with  the  FOR 

calibration  curve  (figure  24),  appears  to  be  superior  to  the  Paper 

Pilot  method  as  a tool  for  understanding,  correlating,  or  predicting 
FOR.  The  best  available  state-of-the-art  model  for  the  estimation 
of  appears  to  be  the  Kleinman  optimal  control  model. 

The  effort  by  Dillow  and  Picha  (reference  25)  appears  to  address 

the  principal  weaknesses  of  the  Paper  Pilot  method  in  its  current 
form.  However,  the  correlations  established  between  actual  POR  and 
their  predictions  for  two  pitch  tracking  data  sets  are  much  less  con- 
vincing than  those  obtained  by  using  the  proposed  metric 

It  is  suggested  that  the  Paper  Pilot  method  can  be  generalized 
and  unified  with  present  theory  and  with  Dillow's  and  Picha's  proposal 
in  exactly  the  manner  suggested  above.  This  will  require: 

1.  use  of  the  Kleinman  model, 

2.  definition  of  the  cost  functional  as  in  equation  25,  and 

3.  use  of  figure  24  to  estimate  POR  given  a predicted  value 

for  the  metric  % (or,  in  general,  0^^  ). 

The  relative  weighting  factor  r in  equation  25  should  be  determined 
to  ensure  an  acceptable  match  between  predicted  and  measured  system 
performance  and  POR  for  a baseline  data  set  (e.g.  Arnold's,  reference 
18).  It  may  be  task-dependent.  This  should  be  investigated  in  future 
research. 

It  is  anticipated  that  this  generalized  Paper  Pilot  should  largely 
eliminate  past  difficulties  in  making  a priori  assessments  of  how  the 
cost  functional  weights  might  vary  with  task  specifics.  Future  re- 
search may  establish  that  these  are  not  highly  variable  among  single 
degree-of-f reedom  tracking  task  data  sets  (such  as  attitude  control  or 
"pipper"  tracking). 

The  Kleinman  model  and  the  conventional  Paper  Pilot  can  be  applied 
to  the  anaiysis  of  multiple  loop  or  multiple  axis  tracking.  The  gen- 
eralized Paper  Pilot  model  proposed  here  can  also  be  used  for  such 
tasks.  Unfortunately,  as  was  previously  discussed  in  this  section, 
neither  the  Kleinman  model  nor  the  servo  model  for  pilot  dynamics 
appears  to  be  suitable  for  quantitative  prediction  of  the  generalized 
POR  metric  ; in  fact,  the  proper  definition  of  for  higher- 

order  control  tasks  is  not  entirely  clear.  Nevertheless,  from  earlier 
discussion,  if  the  proposed,  general  Paper  Pilot  model  is  used  for  the 
study  of  such  tasks,  tlien  0^^  - - however  it  is  defined  - - should 


correctly  rank  vehicle  configurations  according  to  their  handling 
qualities  acceptability.  Also,  from  previous  arguments  regarding 
the  Miller-Vinje  data,  it  is  postulated  that  the  method  will  yield 
a satisfactory,  quantitative  prediction  of  POR  for  actual  Level  1 
configurations. 
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SECTION  V 

IMEI.ICATIONS  TO  M1I-F-8785B 
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A.  OENEhCU.  COMMENTS 

The  theory  Tor  the  pred to t ion  of  pilot  opinion  rating,  presented 
in  Seetion  IV,  is  directly  applicable  to  the  single  loop  control  of 
aircraft  attitude  with  command  or  disturbance  inputs  and  witli  any 
airframe  or  automatic  controller  dynamics.  The  purpose  of  this  section 
is  to  compare  the  predictions  of  this  theory  with  tlie  current  require- 
ments of  M1L-F-8785B.  Only  the  longitudinal  short-period.  Category  A 
requirements  for  up-and-away  flight  will  be  considered.  It  is  anti- 
cipated that  this  application  will  accomplish  three  goals: 

1.  It  will  establish  general  confidence  in  the  theory  for  FOR 
l)redictiou  by  showing  that,  over  large  regions,  it  substantially  agrees 
with  the  flying  qualities  specification;  this,  after  all,  is  based  on 

an  amalgamation  of  experimental  data  collected  over  a span  of  many  years. 

2.  it  will  suggest  areas  in  which  the  specification  is  deficient 
and  offer  guidelines  for  its  improvement. 

3.  It  will  suggest  an  analytical  approach  to  the  general  task 
of  updating  and  extending  the  specification  to  encompass  nonclasslcal 
airframe  dynamic  conf igurat ions  as  might  result  from  changing  operational 
or  performance  requirements  or  from  the  use  of  highly  augmented  auto- 
matic flight  control  systems. 

The  short-period  requirements  are  selected  for  study  since  these  are 
important,  fall  witliin  the  current  practical  limitations  of  the  rating 
prediction  theory,  and  have  long  been  a major  source  of  controversy 
among  the  flying  qualities  community.  It  is  tlierefore  anticipated  that 
the  analyses  of  this  section  will  contribute  to  a more  unified  under- 
standing of  this  important  problem  area. 


B.  SELECTED  AIRFRAME  DYNAMIC  CONFICURATIONS 

In  order  to  test  the  proposed  theory  for  pilot  opinion  prediction 
against  MIL-F-8785B  it  is  necessary  that  a number  of  airframe  dynamic 
configurations  be  selected  for  analysis.  Their  dynamics  should  be 
tailored  to  emphasize  particular  attributes  of  the  specification. 
MII.-F-8785B  codifies  aircraft  liandl  ing  qualities  according  to  various 
parameters.  These  represent  specialized  groupings  of  aircraft  stability 
derivatives  and  are  intended  to  correlate  spccifii  features  of  .lircraft 
dynamii-  response  with  the  available  FOR  data  base.  For  the  specification 
of  classical,  short-period  dynamics  the  principal  jiarameters  are  m/oC  , 
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~’'e>2,  , ^sr  > and  CAP.  The  Category  A sliort-period  fre- 

quency and  damping  requirements  from  reference  1 are  slujwn  on 
figure  32.  The  current  version  of  MIL-F-8785B  does  not  specify  iimits 
on  , the  numerator  lead  time  constant  of  the  transfer 

function. 


Three  principal  categories  of  parametric  variations  were  selected 
for  analysis  as  follows: 


Case 

1;  vary 

r\/oc 

with 

constant 

CAP  and  . 

Case 

2;  vary 

n/ot 

with 

constant 

cOjp  and  . 

Case 

3;  vary 

Te 

“i 

with 

constant 

60jp  and  ?sp  • 

Values  for 

<^/oi  , 

CAP, 

<^SP 

and 

corresponding  to  specification 

boundaries,  wherever  applicable,  were  selected  from  figure  32. 
Longitudinal  mode  stability  derivatives  compatible  with  each  combination 
of  specification  parameters  were  derived  by  arbitrarily  selecting 


= -14,54 


‘/s'- 

to  yield  reasonable 
compatible  and 
follows: 


for  all  configurations,  choosing  and 

for  the  prescribed  , and  calculating 

. The  necessary  equations  for  tliis  are 


COjp  = CAP  » n/oc 
3?. 2 />v\ 

' tr.  (i) 


-Mj  -2w 

The  control  effectiveness  was  selected  to  normalize  the  resulting 

calculations  of  the  pilot  rating  metric  with  respect  to  the 

calibration  curve  (figure  24)  derived  from  Arnold's  data  base.  All 
derivatives  are  defined  according  to  conventional  usage  (i.g.  WADC 
TR-58-82) . The  resulting  data  sets  are  tabulated  in  Tables  12,  13  and  14. 


It  should  be  noted  that  the  rotary  derivatives  are  unusual  by 
current  standards  and  the  speed  Uo  (which  is  fixed  by  the  choice  of 
''/ftC  and  ) varies  from  oni'  non-physical  extreme  to  the  other.  Our 

interest  here,  however,  is  only  that  the  short-period  dynamics  are  chosen 
to  be  compatible  with  the  parameters  of  Ml  l,-P-8785'd  and  7®^  . This  will 
be  assured  by  the  satisfaction  of  the  above  5 equ.itions.  [The  reader 
should  note  that  the  Cl^  and  vv/  respoatu's  to  i-ontrol  will  be  reasonable 
by  comparison  with  current  state-of-the-ar'  aircraft  so  long  as 
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are  reasonable].  The  unusual  speed  and  rotary  derivatives  may  be 
more  acceptable  to  the  reader  if  it  is  recognized  that  these  could 
result  from  motion  variable  feedbacks  through  a stability  augmentation 
system.  In  other  words,  and  shown  in  the  data  sets  could 

each  consist  of  an  aerodynamic  component  plus  a component  due  to  feed- 
back augmentation. 


C.  INVESTIGATION  OF  SHORT-PERIOD  REQUIREMENTS 


The  handling  qualities  boundaries  of  figure  32  are  derived 
from  an  empirical  data  base  documented  in  reference  2.  The  purpose 
of  this  article  is  to  assess  the  validity  of  these  boundaries  by 
predicting  the  pilot  opinion  rating  for  short-period  dynamic  config- 
urations complying  with  them.  The  predictions  of  POR  will  be  made 
by  using  the  theory  of  the  last  section  to  estimate  the  pitch  attitude 
control  metric  and,  from  this,  determine  POR  from  the  calibration 

curve  of  figure  24.  The  estimate  for  will  be  made  using  the 

Kleinman-Dillow  model  for  the  human  pilot  in  exactly  the  same  manner 
as  done  for  the  Arnold  experimental  data,  described  in  the  last  section 
The  important  points  about  this  application  are  that  the  same  cost 
functional  and  cost  functional  weights  are  used  as  were  used  for  the 
Arnold  data,  the  basic  control  problem  is  assumed  to  be  pitch  attitude 
control  with  elevator,  and  the  system  disturbance  is  a w-gust  with 
the  same  spectral  properties  as  used  for  the  Arnold  experiment.  The 
same  gust  intensity  Cwo  = 'O  as  used  for  the  Arnold  experiment  was 
used  in  the  present  analysis  for  baseline  comparisons  with  MIL-F-8785B. 
The  pilot-vehicle  system  model  in  block  diagram  form  is  shown  in 
figure  23.  The  cost  functional  weights  and  gust  intensity  selected 
for  the  Arnold  data  are  used  here  since  it  has  already  been  established 
that  they  are  self-consistent  with  both  fixed-base  simulator  and  flight 
test  results;  thus,  the  POR  predictions  should  correspond  as  closely 
as  the  state-of-the-art  will  permit  with  expected  results  in  flight 
test.  Physiological  thresholds  for  human  perception  of  visual  position 
and  rate  were  included  in  the  K-D  model  but  these  had  no  significant 
effect  on  the  estimate  of  • They  are  ignored  in  further  dis- 


cussion. 


The  resulting  K-D  model  parameters  and  predicted  POR  are  shown 
in  Tables  15,  16  and  17  for  the  45  dynamic  configurations  tabulated 
in  Tables  12,  13  and  14.  The  configuration  numbers  shown  in  Tables 
15,  16  and  17  match  those  of  Tables  12,  13  and  14.  Comparisons  of 
these  results  with  MIL-F-8785B  follow. 


The  case  1 data,  showing  the  variation  of  POR  with  r\/(x  at  con- 
stant CAP,  are  plotted  in  figure  33.  The  predicted  POR  for  each  con- 
figuration is  noted  beside  each  data  point.  The  following  points  are 
noted : 


1.  For  CAP  = .16  the  agreement  between  the  model-pred ieted 
FOR  and  the  bevel  2 Specification  boundary  is  remarkably  good.  This 
result,  however,  is  probably  dependent  on  the  existence  of  favorable 

and 

2.  For  CAP  = .28  the  present  specification  requirement  on 

cOjp  V.  n/ot  is  seen  to  be  in  reasonable  agreement  with  POR  predictions 
only  for  r)y{x  S^^ater  than  about  20  (with  2.0).  In  fact,  there 

is  nothing  in  the  theory  of  POR  prediction  to  indicate  that  n/oi  is 
of  any  significance,  per  se,  to  POR;  the  variation  of  POR  with  o/ot  at 
constant  CAP,  as  shown  in  figure  33,  could  only  result  from  variations 
in  . The  data  point  corresponding  to  configuration  8 might  be  con- 
sidered suspect.  For  it,  the  predicted  POR  is  7.9  which  seems  incon- 
sistently high  compared  with  the  overall  trend.  If  this  were  a flight 
test  rating,  the  point  might  be  discounted  due  to  pilot  "variability" 
or  "bias."  Since  it  is  analytically  derived  it  is  tempting  to  attribute 
it  to  a localized  failure  of  the  Kleinman-Dlllow  model  due,  possibly, 
to  non-optimum  clioices  for  cost  functional  weights  (which,  recall, 
are  held  constant  and  equal  to  those  derived  for  the  Arnold  data  set 
for  present  analysis).  However,  there  is  an  alternative  explanation 
which  may  benefit  the  interpretation  of  flight  test  data;  this  will 
be  discussed  later  when  turbulence  effects  are  examined. 

3.  For  CAP  = 3.6  the  model's  predictions  and  the  Level  1 bound- 
ary are  in  excellent  agreement  for  =2.0  and  = 0.5.  The 

choices  =0,2  and  = 0.35  will,  however,  lead  to  predicted 

POR  more  indicative  of  a Level  2 boundary. 

4.  For  CAP  = 10.0  with  = 2.0  and  = 0.35  the  model- 

predicted  POR  is  much  better  than  the  present  specification  would 
indicate.  [In  fact,  for  = 2.0  the  model's  predictions  of  POR 

are  nearly  independent  of  CAP  in  this  region. ] Possibly  the  model 
and  the  specification  would  be  in  better  agreement  if  the  Level  2 
lower  limit  on  ffjp  ( 5'sp  = 0.25)  were  used  in  the  calculation  of 
the  POR  metric.  The  specification  is  known  to  be  weak  in  this  area; 
considerable  artistry  was  used  in  the  definition  of  the  Level  2 
boundary  (CAP  = 10)  as  may  be  seen  from  reference  2. 

The  case  2 data  are  plotted  in  figure  34.  It  is  clear  that  r 
=0.2  the  predicted  POR  are  in  almost  total  disagreement  with 
requirements.  These  data  also  indicate  that  neither  CAP  nor  n/oc. 
correlates  with  predicted  POR.  Short-period  natural  frequency,  however, 
has  a strong  effect. 

The  case  3 data  are  not  plotted.  The  configurations  examined 
should  all  be  Level  1 if  one  can  believe  MIL-F-8785B.  It  is  seen 
(Tabic  17)  that  the  predicted  PORs  vary  from  the  I.i'vel  2 boundary  to 
unf lyable . 
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In  general,  it  is  apparent  that  '/Tej^  can  have  a powerful  effect 
on  POR.  Variations  in  this  parameter  from  optimum  can  completely 
destroy  the  validity  of  MIL-F-8785B  as  a useful  specification  of 
flying  qualities  to  be  expected  from  a new  aircraft  design.  It  is 
also  obvious  that,  by  present  theory,  neitlier  CAP  nor  n/ot  are  directly 
relevant  to  the  prediction  of  closed  loop  flying  qualities  of  the 
sort  encompassed  by  the  Category  A definition.  The  involvement  of 
both  CAP  and  *^/o£  is  confused  by  the  fact  that  both  have  intuitive  and 
possible  practical  merit  for  the  evaluation  of  flying  qualities  of 
tasks  involving  rapid  and  precise  maneuvering  from  one  trajectory  to 
another.  Such  tasks  are  included  within  the  Category  A definition  of 
the  current  specification.  Furthermore,  both  CAP  and  m/oc.  are  related 
to  each  otlier  and  to  the  closed  loop  parameters  of  interest  to  the  pres- 
ent flying  qualities  theory  through  the  parameter  Uo  • Speed  is  not 
usually  variable  over  a wide  range  for  the  flight  test  determination 
of  POR  vs.  some  prescribed  parameter.  As  a consequence  either  CAP  or 
n/ot  will,  to  some  extent,  correlate  with  POR  trends  observable  from 
existing  data  bases.  Their  use  in  the  current  version  of  M1L-F-8785B 
for  the  specification  of  short  period  flying  quality  requirements  is 
akin  to  treating  the  symptoms  of  the  problem  and  not  the  disease. 

There  is  a further  confusion  factor  Involving  these  two  parameters;  a 
discussion  of  this  will  be  deferred  until  the  next  Article. 

The  opinion  of  this  author  is  that  the  predictions  of  POR  using 
the  theory  proposed  in  this  report  are  in  good  agreement  with  the  short- 
period  requirements  of  M1L-F-8785B  in  those  areas  where  the  specifi- 
cation is  a reasonable  empirical  correlation  of  the  available  data, 
and  for  satisfactory  choices  of  In  other  areas,  it  is  this 

author's  opinion  that  the  theory  is  more  versatile  and  reliable  than 
the  specification. 


D.  TURBULENCE  EFFECTS 

The  theory  of  this  report  for  the  prediction  of  POR  indicates 
that  turbulence  intensity  will  affect  the  prediction  of  <T/a^  and, 
therefore,  POR.  MIL-F-8785B  does  not  address  this  potential  problem 
area.  We  wish  to  examine  the  effects  on  predicted  POR  of  varying 
CiMq  and,  from  this,  draw  inference  as  to  whether  or  not  gust  effects 
should  be  incorporated  into  the  attitude  control  requirements  of  the 
specification.  This  will  be  done  only  for  a few  configurations.  Tables 
18,  19  and  20  summarize  the  Kleinman-Di 1 low  model  parameters  and  pre- 
dicted POR  for  certain  case  1,  2 and  3 configurations,  all  with 
= 16  f/s.  Table  21  shows  tlie  results  for  other  case  1 configurations 
with  Ojvg  = 5.0  f/s.  Comparison  of  these  predicted  POR  values  with  those 
for  Owy  = 10  f/s  (Tables  15-17)  indicates: 

1.  The  Levels  2 and  3 specification  boundary  for  CAP  = 0.16  is  some- 
what degraded  at  the  higher  gust  intensity  condition  but  is  still  reasonable 


with  respect  to  the  theoretical  POR.  This,  of  course,  is  strictly 
true  only  for  the  values  of  and  used. 

2.  The  Level  1 specification  boundary  for  CAP  = 3.6  with 
0.2  and  ^SP  = 0.35  is  even  more  inadequate  for  the  higher 

gust  ievel  than  it  was  for  = 10  f/s. 

3.  The  Case  2 configurations  for  constant co^(=  0.5  and  3.0) 
are  not  substantially  affected  by  the  higher  turbulence  level.  The 
largest  POR  degradation  is  for  the  poorer  POR  cases  (for  60jp=  3.0); 
this  is  only  about  0.8  units,  however. 

4.  The  case  3 configurations  that  are  predicted  to  be.  flyable 
with  (Twj  - 10  (configurations  37,  38,  39  and  40)  are  predicted  to 
remain  flyable  with  OVvj = 16.  The  POR  is  predicted  to  increase,  however, 
by  about  0.8  units.  The  unflyable  configurations  are  predicted  to 
remain  unflyable  at  the  higher  turbulence  level,  as  expected. 

5.  The  Level  1 specification  boundary  for  CAP  = 0.28  is  a very 

good  match  for  the  predicted  POR  with  - 0.5,  ' 2.0  and 

(7wj  =5.  An  isolated  exception  is  configuration  8 which  appears  to 
have  a predicted  POR  out  of  line  with  the  indicated  trend  for  in- 
creasing n/cK  . This  also  was  observed  withOV/j=  10.  More  on  this 
later.  The  decrease  in  turbulence  intensity  from  10  to  5 f/s  is  pre- 
dicted to  give  a substantial  improvement  on  POR  for  the  more  poorly 
rated  configurations  with  CAP  = 0.28;  the  corresponding  improvement 
for  the  better  configurations  is  much  smaller.  Decreasing  CTw^  from 
10  to  5 f/s  is  predicted  to  give  a slight  improvement  of  the  CAP  = 3.6 
and  10  configurations.  These,  however,  were  nearly  all  Level  1 con- 
figurations at  Owj  = 10  and  would  be  expected  to  remain  so  with  smaller 
Owj  . Given  the  nonlinear  nature  of  vs.  POR  (figure  24),  very 

large  percentage  decreases  in  are  required  to  produce  a signif- 

icant improvement  in  predicted  POR  for  Level  1 configurations. 

In  general  it  appears  that  there  is  a significant  effect  of  tur- 
bulence intensity  on  predicted  POR  only  for  those  configurations  that 
are  Level  2 or  worse  for  nominal  turbulence  levels.  There  appears  to 
be  a short-period  frequency  effect,  however,  which  produces  an  aggravated 
POR  sensitivity  to  turbulence  level  primarily  at  higher  . The 

value  Cwg  = 10  was  selected  by  Arnold  for  reasons  of  task  realism  in 
fixed  bast  tracking.  The  resulting  POR  predictions  based  on  Arnold's 
data  and  the  proposed  theory  are  in  good  agreement  with  the  Neal-Smith 
flight  test  results  with  the  USAF  variable  stability  T-33.  It  is  hereby 
assumed  that  CWj  = 10  is  a useful  baseline  value  for  the  comparison 
of  predicted  POR  with  M1L-F-8785B  requirements  which,  in  large  part, 
reflect  flight  test  experience.  Then  Owj  = 16  f/s  should  be  assumed 
to  constitute  a very  severe  input  condition.  It  therefore  follows  that 
tlie  intensity  for  random,  gauss  fan  turbulence  should  have  only  small 
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effect  on  the  specification  of  Level  1 short-period  flying  quality  ‘ 

requirements.  The  effect  on  Levels  2 and  3 will  be  stronger  for  the  ; 

higher  CAP  (actually,  higher  cOjp  ) regions.  It  should  therefore  be  ■ 

expected  that  flight  test  measurements  of  FOR  for  CAP  greater  than  ; 

about  4.0  will  likely  contain  spurious  errors  due  to  effects  of  natural 
(and  probably  un-measured)  turbulence. 

Table  22  summarizes  the  variation  of  predicted  POR  with  : 

'''T^^and  ?jp  are  parameters.  These  data  are  tabulated  in  this  fashion 
to  illustrate  the  point  that  preconceived  notions  about  how  to  para- 
meterize POR  data  can  lead  to  possible  misconceptions  about  POR.  For 
the  three  data  sets  shown  it  might  appear  that  monotonic  variations  in 

tOjp  should  result  in  a predicted  monotonic  variation  in  POR.  This  is  j 

generally  true.  Configurations  43,  21,  45  and  8 are  notable  exceptions.  j 

For  each  of  these  the  predicted  POR  is  either  significantly  lower  or  | 

higher  than  those  for  neighboring  configurations  in  the  sequence.  The  j 

irregular  POR  for  these  four  cases  could  be  attributed  to  eccentricities  j 

in  the  Kleinman-Dillow  model  when  used  in  present  fashion.  This  pos-  i 

sibility  was  previously  indicated  for  configuration  8.  If  these  were  j 

flight  test  or  simulator  derived  POR  with  actual  pilots,  however,  these  | 

"irregular"  data  would  likely  be  attributed  to  pilot  variablity.  In  | 

fact,  both  explanations  are  probably  incorrect.  | 

i 

The  real  culprit  in  the  Table  22  data  is  probably  the  airframe  i 

gust  model.  The  airframe  response  to  a gust-induced  angle  of  attack 
ot^  = Wj  /Ua  for  the  short-period  approximation. 
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The  numerator  is  approximately  equal  to  -Mot  for  most  of  the  con- 

figurations examined  in  this  study.  The  values  of  Mot  for  each  of  the 
four  suspect  configurations  and  one  on  each  side  are  listed  in  Table  23. 

It  is  clear  that  for  configurations  43,  21  , 45  and  8 Mo<.  is  either 
much  smaller  or  much  larger  than  for  neighboring  conf igu  "at  ions . The 
effect  on  gust-induced  pitch  attitude  rate  amplitude  is  directly 
reflected  in  the  POR  prediction.  It  is  therefore  concluded  that  the 
apparent  POR  discrepancies  in  the  data  of  Table  22  are  due  to  two  effects; 
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1.  The  (unwarranted)  assumption  that  monotonic  variations 
in  dOjp  should  yield  monotonic  variations  in  POK  with  all  other 
dynamic  parameters  held  constant. 

2.  The  effects  of  airframe  gust  response  on  the  level  of  pitch 
attitude  rate  feedback. 


In  a flight  test  program  designed  for 
various  airframe  dynamics  one  does  not  usua 
the  airframe's  dynamic  response  to  natural 
The  disturbance  due  to  natural  causes  is  no 
therefore,  may  be  a source  of  "variability" 
is  impossible  to  sort  out  without  a measure 
From  earlier  conclusions  in  this  Article  it 
errors  of  this  sort  would  be  most  likely  to 
configurations  in  the  region  of  higher 


the  collection  of  FOR  for 
lly  have  full  control  over 
atmospheric  turbulence, 
t usually  determined  and, 
in  pilot  rating  data  that 
of  the  POR  metric 
is  probable  that  spurious 
occur  for  Levels  2 and  3 


The  airframe's  response  to  an  OC  - gust  is  parameterized  by: 


§ 

1. 

The 

2. 

The 

3. 

Zw 

X = -Ma  + U. 


Observe  that  and  Hw  are  directly  related  to  the  M1L-F-8785B 

parameters  CAP  and  in  the  following  way  (the  usual  approximations 

are  employed) ; 


9 


- (-) 
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It  therefore  follows  that  CAP  and  n/ot  can  affect  POR,  even  for  non- 
maneuvering tracking,  by  sliaping  the  turbulence  spectrum  to  determine 
the  level  of  airframe  excitation.  Tlius  they  may  in  effect  become 
closed  loop  parameters  of  significance.  It  has  already  been  indicated 
that  their  effects  on  closed  loop  tracking  POR  will  probably  be  isolated 
at  the  higiier  , Levels  2 and  3 dynamic  configurations.  In  general, 

it  is  suspected  that  CAP  and  m/cx.  are  parameters  of  second-order  im- 
portance to  the  determination  of  closed  loop  POR.  There  may  be  unusual 
combinations  of  airframe  aerodynamic  response  and  response  to  control 
for  whicii  their  effects  are  very  important.  This  may  arise  in 
applications  of  tiie  control-configured  vehicle  concept,  with  various 
possible  gust  alleviation  systems,  or  with  path  control  systems  using 
direct  force  generation. 
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« 
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K.  MOTION  CUE  EFFECTS 

Certain  of  the  case  1 and  all  the  cases  2 and  3 airframe  config- 
urations were  re-analyzed.  The  Kleinman-Dillow  model  was  modified 
from  that  previously  applied  to  these  data  by  the  feedback  of  , 

the  normal  acceleration  at  the  pilot's  station,  and  the  angular  motions 
9 and  6 . Two  pilot  locations,  20  and  60  feet  ahead  of  the  air- 
craft's center  of  gravity,  were  evaluated.  The  detailed  results  will 
not  be  shown  here. 

The  purpose  of  this  study  was  to  make  an  exploratory  assessment  of 
motion  feedback  effects  on  the  calculation  of  No  readily  usable 

data  were  available  to  permit  the  construction  of  a reliable  cost  function, 
with  weights,  which  incorporated  the  motion  cues.  Instead,  the  author 
elected  to  use  zero  weightings  on  © , © and  with  the  same 

weights  on  & and  © as  used  in  the  analysis  of  Arnold's  data.  It 
was  expected  that  this  would  ensure  tliat  differences  in  predicted  POR 
with  and  without  motion  would  reflect  only  motion  effects  and  not 
effects  due  to  the  choice  of  cost  functional. 

It  was  found  that  in  nearly  every  case  the  equivalent  Kalman  filter 
gain  was  larger  with  motion  cues  than  without.  This  is  the  result  of 
higher  quality  predictions  of  state  due  to  the  availability  of  the  higher 
derivatives  to  the  predictor.  Also,  in  nearly  all  cases  the  value  0"^ 
decreased  with  the  addition  of  motion.  The  feedback  control  gains  Kq 
and  were  not  affected.  The  percentage  increase  in  the  Kalman  filter 
gain  was  greater  than  the  percentage  decrease  in  . The  result  of 

motion  addition  was,  therefore,  to  increase  the  POR  metric  ^5,  • The 

predicted  increase  in  POR  was  between  0 and  0.8  units  in  all  cases.  The 
good  configurations  were  not  significantly  affected  by  motion;  the  poor 
configurations  suffered  the  largest  increase  in  POR.  There  was  no 
significant  effect  of  pilot  location  relative  to  the  center  of  gravity 
on  the  predicted  POR. 
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The  pliysical  signil  icance  of  these  results  is  difficult  to  assess. 
Tliey  are  too  preliminary  to  permit  any  resolution  of  questions  per- 
taining to  motion  cues  and  their  significance  to  fliglit  test  measure- 
ment of  I’OR.  It  is  suspected,  however,  tliat  an  appropriate  cost 
functional  for  the  Kleinman  model  (i.e.  one  whicli  properly  weights 
the  motion  cues)  will  enable  the  quantitative  assessment  of  motion 
effects  on  POR  througli  application  of  tlie  tlieory  proposed  in  this 
report.  Tlie  present  study  results  of  motion  effects  are  probably 
biased  by  failure  to  weight  Qg,,  in  tlie  cost  functional.  For  certain 
of  the  poorly  rated  configurations  it  seems  reasonable  to  expect  im- 
provements in  POR  due  to  motion.  The  data  of  figure  27,  for  example, 
indicate  that  his  may  be  true. 


F.  OBSERVATIONS,  CONCLUSIONS  AND  RF.COMMENDATIONS 

The  shortcomings  of  M1L-F-8785B  are  well-known.  The  specifi- 
cation requirements  are  empirical  and  are  not  well-founded  in  theory. 
The  handiing  quality  data  base  for  the  specification  is  limited  and 
expensive  to  extend.  Combinations  of  classical  vehicle  dynamic  para- 
meters can  often  be  found  to  yield  configurations  with  handling  qual- 
ities contradictory  to  what  M1L-F-8785B  would  Indicate.  The  document 
is  not  directly  and  obviously  suitable  for  the  design  specification 
of  highly  augmented  aircraft.  It  gives  no  guidance  for  estimating 
the  effects  of  turbulence  on  handling  qualities  and  the  possible  con- 
sequence to  design.  The  significance  of  piloting  task  details  can  be 
assessed  only  in  the  most  convoluted  manner,  if  at  all. 

The  motivation  behind  the  present  work  was  the  desire  to  develop 
analytical  methods  for  handling  quality  prediction  that  are  not  sub- 
ject to  these  practical  limitations.  This  goal  has  been  partially 
accomplished.  The  resulting  theory  for  pilot  rating  prediction  is 
directly  applicable  to  those  flying  qualities  tasks  that  can  be  char- 
acterized as  fundamentally  single-axis  in  nature;  these  include  a broad 
and  important  spectrum  of  flight  control  problems.  It  has  been  noted 
that,  although  the  theory  for  rating  prediction  is  general  in  scope, 
it  is  practically  limited  to  single-axis  tasks  by  the  current  state- 
of-the-art  of  ])iiot  model  development.  The  development  of  pilot  models 
suitable  for  rating  prediction  in  multipl'  axis  or  multiple  loop  tasks 
is  a goal  for  future  research.  Still,  it  is  not  entirely  clear  how  a 
general  and  ''alid  theory  for  rating  prediction  should  be  implemented 
to  overcome  the  present  shortcomings  of  MIL-F-8785R.  That  too  is  a 
subject  for  researcli. 

Certain  features  of  MIL-F-8785B  are  objectionable  from  the  view- 
point provided  by  present  theory.  The  short-period  dynamic,  require- 
ments, for  example,  emphasize  the  importance  to  handling  qualities  of 
/oL  and  the  CAP  parameter  - - neither  of  which  ^irecj^l^  influences 
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pilot  rating;,  according  to  present  theory,  for  closed  loop  precision 
control  tasks.  This  situation  is  furtlier  confused  by  two  compli- 
cat ions: 

1.  Botli  n/ot  and  CAP  partly  parameterize  the  airframe's  gust  re- 
sponse and  will  therefore  correlate  pilot  rating  data  to  some  extent. 

2.  The  Category  definitions  in  M1L-F-8785B  include  both  open  loop 
and  closed  loop  piloting  tasks  in  each  of  Categories  A and  C.  It  is 
probably  true  that  normal  acceleration  response  is  important  to  open 
loop  short-period  flying  qualities;  n /pc  and  CAP  could  conceivably  be 
suitable  for  the  parameterization  of  normal  acceleration  control 
(although  this  has  not  really  been  established  from  theory  or  from 
flight  test)  and  would  therefore  correlate  pilot  rating  data  from 
flight  tests  involving  open  loop  maneuvering  tasks.  Since  much  of 
the  current  handling  qualities  data  base  is  derived  from  such  flight 
tests,  we  can  expect  that  r>/pc  and  CAP  will  correlate  with  pilot 
ratings;  unfortunately,  it  is  conceivable  that  this  correlation  may 
confuse  the  proper  interpretation  of  these  data  - - at  least  for  pre- 
cision, closed  loop  control  tasks. 

It  appears  to  be  generally  true  that  the  art  of  pilot-vehicle 
systems  analysis  has  had  very  little  impact  on  MIL-F-8785B.  This  is, 
partly  due  to  the  essential  weakness  of  the  state-of-the-art  of  anal- 
ytical flying  qualities.  Nevertheless  the  theory  of  pilot-vehicle  sys- 
tem dynamics  has  permitted  the  identification  of  several  important 
handling  quality  parameters.  The  importance  of  the  pitch  attitude 
transfer  function  zero  , for  example,  was  originally  identified 

through  use  of  pilot-vehicle  systems  analysis  and  has  been  confirmed 
by  experiment;  it  still  does  not  directly  appear  in  the  short  period 
flying  quality  requirements  of  MIL-F-8785B. 

The  parameterization  of  flying  qualities  in  terms  of  modal  para- 
meters is  difficult  in  part  because  no  one  parameter  is  completely 
independent  from  the  rest  - - at  least  not  in  the  practical  sense. 

The  theory  presented  in  this  report  for  the  assessment  and  prediction 
of  pilot  opinion  ratings  directs  that  FOR  be  correlated  only  with  the 
metric  ; this,  however,  is  a result  of  closed  loop  control  activity 

by  the  pilot.  The  metric  is  not  obviously  suited  for  use  in  spe- 

cifying aircraft  design. 

Or  is  it?  A future  version  of  MIL-F-8785B  might  require  that 
the  short-period  dynamics  be  such  as  to  yield  0)^^  S 0.4  degrees  for 
Level  1 handling  qualities.  This  would  be  the  only  necessary  short- 
period  requirement  for  closed  loop  flying  qualities.  However,  such 
a specification  statement  would  require  that  an  adequate  model  exist 
for  predicting  , that  methods  be  available  for  the  direct  meas- 

urement of  C3^  from  flight  test  (in  order  to  certify  the  satisfaction 
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of  the  ciosij;n  ro(|ii i romont ) , and  that  the  test  pilot  perform  to  the 
limits  of  his  eapabilities  during  the  certification  flight  tests. 

Even  witli  all  these  factors  given,  the  real  proof  of  the  de- 
sign will  rest  with  the  pilot's  opinion  rating.  The  validity  of 
present  theory  would  require,  however,  that  the  actual  rating  be  con- 
sistent with  the  measured  . In  this  sense,  the  actual  rating 

would  be  redundant  except  as  a final  cross-check.  This  analytical 
approach  to  the  specif ication  of  flying  qualities  seems  impractical 
in  view  of  the  present  state-of-the-art;  the  philosophy  may  be  sound, 
however,  and  should  be  fairly  and  objectively  evaluated. 

On  the  other  hand,  there  is  no  obvious  reason  to  preclude  the 
use  of  present  theory  as  a design  guide  for  flying  qualities  - - 
especially  for  those  vehicle  configurations  that  cannot  be  directly 
assessed  through  the  use  of  MIL-F-8785B.  This  might  be  more  realistic 
than  the  alternative  approach  of  using  MIL-F-8785B  and  its  back-up 
documentation  as  a speculative  basis  for  the  assessment  of  probable 
flying  qualities.  Accordingly,  it  is  recommended  that  MIL-F-8785B 
be  revised  to  cite  the  theory  for  pilot  opinion  rating  contained  in 
this  report  as  an  optional  method  for  flying  qualities  assessment 
of  those  vehicles  for  which  the  detailed  specification  is  inapplicable 
by  reason,  for  example,  of  augmentation  or  configuration  design.  The 
method  should  be  standardized  to  include  the  pilot  model,  the  control 
effectiveness,  the  turbulence  model,  and  an  algorithm  for  selection 
of  the  pilot  model  parameters  and  for  the  prediction  of  pilot  ratings. 
The  use  of  the  Kleinman  model  with  the  empirical  calibration  of 
figure  24  is  recommmended  until  a more  universal  model  for  pilot 
dynamics  becomes  available. 

At  various  places  throughout  this  report  it  has  been  hinted  that 
the  theory  should  be  applicable  for  non-tracking  or  non-continuous 
tracking  tasks.  It  was  also  noted  in  the  introduction  that  we  define 
aircraft  flying  qualities  in  terms  of  pilot  opinion  rating  primarily 
because  we  don't  know  how  else  to  define  flying  qualities  and  because 
the  pilot  has  been  the  traditional  final  judge  of  an  aircraft's  suit- 
ability. Pilot  opinion  rating  requires  a quantitative  scale,  however; 
the  scale  and  the  manner  in  which  it  is  used  may  permit  too  much  ar- 
bitrary choice  to  creep  into  the  experimental  assessment  of  flying 
qualities.  This  is  (or  should  be)  a particular  concern  with  regard 
to  the  future  design  of  aircraft,  displays,  or  weapons  that  are  novel 
in  their  piloting  requirements  or  that  place  considerable  emphasis 
on  system  accuracy  requirements  during  short  time  intervals.  It  is 
beyond  the  state-of-the-art  at  this  time  to  assess  the  significance 
of  pilot  opinion  rating  data  obtained  from  such  tasks.  For  sucli  tasks, 
pilot  opinion  ratings  may  not  be  the  best  measure  for  handling  qual- 
ities. This,  too,  is  a subject  for  future  research. 


9 3 


APPENDIX  A 


A COMPUTER  MODEL  FOR  A NONLINEAR  TIME  DELAY 


A.  GENERAL  DESCRIPTION 

The  subroutine  XDELAY  described  in  this  appendix  is  a digital 
computer  model  intended  for  the  simulation  of  a nonlinear  time  delay 
t = 

The  signal  ^ (.t;)  is  the  input  signal  to  the  delay  at  time  f=t; 

The  corresponding  time  delay  is  T;  . If  on  the  interval  ‘ ^ "'■i  > 

a value  occurs  for  which  S t;  , then  it  is 

assumed  that  the  output  of  XDELAY  at  t i •*■■>:»  will  not  be 

determined  by  x(tl  where  t;  i:  t s tn,  . That  is,  on  the  interval 

will  have  no  effect  on  the  response  of  the  nonlinear  delay 
model  XDELAY.  In  this  way,  the  nonlinear  delay  acts  like  a peculiar 
filter.  The  major  difficulty  in  programming  XDELAY  is  due  to  this 
property  that  creates  "null-subsets"  of  xlt). 

The  nonlinear  delay  response  and  response  time  are  programmed 
as  subscripted  files  XOUT(I)  and  TIMEOUT(I)  such  that 

XOUT(I)  = x(t) 

TIMEOUT(I)  = t + -C 

These  are  created  on-line  during  a simulation  exercise.  The  indexing 
variable  I is  re-set  in  XDELAY  whenever  a null-subset  of  x(t)  has  been 
identified  in  order  to  over-write  the  stored  output  files  XOUT  and  TIMEOUT. 

Wlten  a system  simulation  involving  XDEiJiY  is  conducted,  it  is 
assumed  that  the  XDELAY  output  files  are  initially  null;  tlie  first  non- 
zero input  xltj  will  begin  to  fill  thes*>.  When  the  current  value  of 
simulation  time  T becomes  equal  to  or  greater  than  TIMEOUT,  tlien  a non- 
zero response  from  XDELAY  is  required.  If  T=TIMEOUT  (I)  then  the  re- 
sponse of  tlie  nonlinear  delay  will  be  XDLAY  = XOUT(l)  where  XOUT(l)  = 
X(T-"C)  where  "C  = AK/  XOUT(l)  . This  is  an  unlikely  occurrence,  however. 

In  general,  XDLAY  must  be  determined  by  interpolation  within  tlie  output 
files.  This  is  accomplished  in  XDELAY  by  a fourth-order  Lagrange  inter- 
polation algorithm.  Its  use  requires  that  four  values  of  I he  determined 
for  which  TIMEOUT  (T,  ) •^  T <•  TIMEOUT  (I^)  where 

tz  = I,  + 1 

Ij  = 1,  + 2 

I = 1,  + 3 


Ttif  pro^r.im  is  mt'i'li  in  i zed  to  ehoose  I such  tlial 


r 1 MHOUT (1 2 ) <:  T < T IMEOUT ( 1 j ) 

to  maximize  tlie  accuracs'  of  tiie  interpolation.  Tliere  .ire  two  rases 
when  this  is  not  possible.  The  first  rase  occurs  when 

■i' I MF.OUT  (1 ) < T < T I Ml'OUT ( 2 ) . I >4 

in  that  case  the  output  file  points  for  1 = 1,2,  '3,  and  4 are  selected 
and  the  interpolation  is  made  over  these  with  no  turther  mod i f i ca t ions 
rei|uired.  The  second  case  is  more  troublesome.  If  ;i  verv  l.irf,e, 
sudden  increase  occurs  in  |xCt)l  at  near  the  st.irt  of  a 

simulation  then  all  of  the  output  file  storage  for  'I'lMKOUT  > T (.-an  he 
over-written  and  only  that  due  to  the  current  input  rem.iins;  in  that 
case,  insufficient  storage  exists  for  the  exercise  ot  the  interpolation 
algorithm..  This  problem  is  an  inherent  property  of  the  .sinul.it  ion  and 
cannot  be  avoided  by,  for  example,  choosing  a sm.illc-r  program  step 
size  ziT.  The  solution  to  this  problem,  as  programmed,  is  to  use  the 
last  three  values  of  the  subroutine  output  XDl.AY  and  the  output  times 
T plus  the  remaining  point  in  the  output  file  to  providi'  tlu'  necessary 
four  data  points  for  the  interpolation  algorithm.  Therefore,  it  is 
necessary  that  the  output  of  subroutine  XDKI.AY  be  subscripted  for  iden- 
tification and  recall,  if  necessary.  The  files  for  storage  of  XDFl.AY 
re.sponse  and  response  time  .are  called  XHOlli  and  TSTOHF,  respectively. 

Occasionally,  the  over-tvr it ing  of  the  output  files  such  as  described 
above  will  occur  before  three  reaponse.s  have  been  obtained  from  XDFLAY . 

In  thill  case,  the  combination  of  XOUT(l)  iind  the  output  storage  XflOl.l) 
will  not  yield  four  points  for  use  by  the  interpolator.  This  usually 
indicates  that  the  program  .step  size  T is  too  large.  Tlie  program 
XDKLAY  detects  this  condition,  prints  an  error  message  and  aborts  the 
program  execution. 

rhe  subroutine  XDKI.AY  is  designed  lo  operate  in  conjunction  with  a 
subroutine  INTEG  for  1 he  numerical  integr.it ion  for  a system  of  differ- 
ential equations.  1 M'l  EC  may  use  either  a forward  integration  or  a 
pred i c t or-correc t or  algorithm  and  he  compatible  with  XDKLAY.  Either 
method,  in  general,  will  occasionally  result  in  the  bac k-spae 1 ng  of 
time  tor  the  control  of  integration  step  size  and  .-Rcuracy.  A test 
for  Ibis  condition  is  made  in  XDEl.AY.  Wlien  it  ocenrs,  the  subscripting 
indices  for  all  output  and  stor.ige  files  are  re-sel  to  reflect  tlie 
liack-Siiac  i ng  ul  X(t),  Continued  svstem  ojuTalion  I lii'ii  results  in  tlie 
over-writing  of  tliese  files.  it  is  not,  in  genet. il,  known  in  .adv.-nice 
liow  mucli  storage  will  lie  required  lo  allow  li'r  llie  bacl.-spar  ing  ot 
time.  file  programming  solution  adopted  w.is  to  retain  only  t tie  most 
recent  32  values  for  X1101,l)  and  TSTORE,  and  300  values  for  XOIJT  ;ind 
TTMEOC’f.  This  re-scquenc  ing,  opcr.it  ion  is  performed  i-verv  20  program 
steps  for  XHOLD  and  T.STOP.K  and  every  200  steps  for  XiUlT  .in-.i  TIMEOUT. 
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Comp. it  ihiliLy  ol  XDKI.AY  and  iNTFX,  in  genoral  , requires  lliat  the 
response  XDl.iW  noL  be  clianged  until  a valid  integration  step  has  been 
lompleted  in  INTl-X.  The  logical  variable  GOOD  is  available  in  XDKl.AY 
t\vr  this  purpose.  It  is  assumed  that  GOOD  is  set  to  FALSE  by  INTFG  at 
i n t ermed i.it e integration  points  with  GOOD  set  to  TRUE  for  vaiid  points 
corresponding  to  valid  solutions  of  the  system  differential  equations. 

If  GOOD  is  FALSE  upon  entry  to  XUELAY,  an  automatic  return  to  the 
calling  progr.im  (usually  a derivative  subroutine  for  INTEG)  is  made. 

The  program  defined  in  this  appendix  is  known  to  be  deficient  in 
one  respect;  it  will  produce  a step  response  for  a pulse  input.  The 
computer  model  was  designed  Co  simulate  a human  pilot's  time  del.iy  in 
the  perception  of  visual  rate  stimuli  in  a closed  loop  feedback  control 
system.  Physiological  data,  known  to  this  author  at  the  time  XDEI.AY 
was  prepared,  were  insufficient  to  permit  the  determination  of  precisely 
wlien  tile  rate  x(t}  should  be  used  for  the  determination  of  X or  when  the 
change  in  rate  should  be  used.  The  author  elected  to  ignore 

■ for  the  calculation  of  X and  use  only  the  current  value  ^ it)  . At  the 

< conclusion  of  an  input  pulse  x(t)=0  and  t-oo  ; thus,  a pulse  input 

becomes  a step  response  in  tlie  present  mechanization  of  XDELAY.  This 
is  not  regarded  as  a serious  deficiency  in  a closed  loop  system  simulation 
^ since  pulses  don't  generally  occur  in  system  rate.  In  the  simulations 

for  which  XDELjIY  was  used  in  the  program  described  in  this  report  > it) 

' tended  to  be  periodic  in  nature.  For  periodic  or  near-periodic  x it)  , 

.XDELAY  is  probably  satisfactory  as  programmed.  A better  pliysical  model 
for  human  visual  sensation  of  rate  would  be  required  for  the  remedy  of 
this  defect.  Such  a model  might  incorporate  a comparator  and  a refractorv 
delay  mechanism  of  some  sort  which  would  generate  a time  delay  dependent 
upon  changes  in  rate  over  a refraction  interval. 


> 
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B.  DEFINITIONS  OF  VARIABLES  USED  IN  SUBROUTINE  XDELAY 

1.  A = coefficients  computed  for  use  in  the  Lagrange  interpolation. 

2.  AK  = the  constant  of  proportionality  in  the  expression  for  the 
nonlinear  time  delay: 

TAU  - AK  / I X 1 


3.  DK  = AK/4;  this  is,  in  effect,  used  as  a threshold  value  for 
TAF.  When  |xl  * DK  at  an  entry  time  T,  no  time  delay  computation 
is  performed  and  XDLAY  is  set  to  the  last  value  c<'mputed.  Tliis  is 
done  to  avoid  needless  computation  and  storage  associated  with  small 
X which  will  become  :i  null-set  member. 


Vs 


DLTX  = \ X,  1 


5.  GOOD  is  a logical  variable  that  must  be  set  to  TRUK  by 
an  integration  subroutine  at  points  for  which  the  values  X and  T 
correspond  to  a valid  solution  to  the  system  of  differential  equa- 
tions. GOOD  must  be  set  to  FAl.SK  at  points  of  intermediate  lalcula- 
tion  within  the  integration  subroutine.  It  is  available  to  XDKl.AV 
from  the  labeled  common  block  INGTRL. 

6.  I = an  indexing  subscript  used  for  the  sequeni  ing  of  XOUT 
and  TIMEOUT. 

7.  I KY  = 1 or  2 ; it  is  a counter  used  to  by-pass  the  inter- 
polation mode  at  to  set  the  output  XUI.AY  to  zero  at  the  time  of  first 
entry. 

8.  INTRP  = a variable  supplied  by  the  integration  subroutine 
and  available,  as  an  external  control,  to  XDKLAY  through  the  labi-led 
common  block  INCTRL.  It  is  not  used  in  XDKLAY  as  programmed. 

9.  ISCORE  = 1 or  2;  it  is  set  to  1 in  the  MAI.N  program  .il  the 
program  start  time  and  re-set  to  2 by  .XDELAY.  It  is  an  argument  list 
variable  used  only  for  establishing  the  initial  conditions  in  XDELAY. 

10.  J = an  indexing  subscript  used  for  the  sequencing  oi  XHOLD 
and  TSTORE. 

11.  TILLY  = a do-loop  variable  used  only  to  chock  for  monotonic 
sequencing  of  TIMEOUT  and  possible  re-sequencing  of  TIMEOUT  and  XOUT. 

12.  T = the  current  (entry)  time;  an  argument  list  variable. 

IJ.  TAU  = t , the  nonlinear  delay  time. 

14.  TIMEOUT  = T + TAU,  the  time  at  which  the  current  ini>ut  X to 
XDEIjXY  is  to  become  equal  to  the  resptnise  XDLAY;  i.e.  XDl.AY  (T  + T.AU) 
= X(T). 


13.  TOLD  = the  list  value  of  T for  wliich  an  entry  to  XDEL.AY  was 


made 


lb.  TSTORE  = the  time  for  which  the  del.iy  response  XD!j\Y  was 
produced;  TSTORE  is  used  to  determine  whether  back-spacing  oi  T has 
occurred  due  to  the  integration  subroutine  and  for  interpolation  when 
the  outptit  files  are  sufficiently  over-written  by  encounter  with  a 
null -subset  of  X. 

17.  TT  - interim  storage  location  for  TIMEOUT  lor  use  in  the 
Lagr.inge  interpol  at  ii>n  - - a dummy  variable. 


18.  X = Lhe  (.urreiit  (entryl  valiif  nf  Llie  sign.il  Lo  be  delayed; 
an  argument  list  variable. 

19.  XDl-AY  = tlie  desired  n spense  from  XDELAY  at  the  current 
t ime  T. 

20.  XHOLD  = the  subsi-ripted  equivalent  of  XDLAY  used  for  tem- 
porary storage  of  the  delay's  response;  XHOLD  is  used  for  interpo- 
lation whenever  the  output  files  XOUT  is  sufficiently  over-written 
by  encounter  witli  a null-subset  of  X or  due  to  the  back-spacing  of 

t ime  T. 

21.  XOLD  = X 

22.  XOUT  = tlie  computed  outpi\t  required  at  the  time  T = TIMEOUT. 

23.  XX  = values  of  XOUT  corresponding  to  TT  for  use  in  the 

, Lagrange  interpolation  - - a dummy  variable. 

C.  I’ROGfUYM  LISTING 

( 

fA  listing  for  XDELAY  is  given  on  the  following  pages.  Th.e  program 
is  prepared  in  fortran  IV. 
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t SUB'^OUTINt  Xf)ELAY(T,X,XOLAY,AK,ISCOK“'^) 

t DIMENSION  A(4),  T I ME  O'J  T ( S 0 0 ) , XOUKEOO),  TSrORE(B2),  XH0L0(62) 

I LOGICAL  GOOD 

DIMENSION  TT  (4)  , XX  »4) 

COMMON  /INCTRL/  INTRP,GOOD 


GOOO  IS'  SUPPLIED  3Y  INTEG.  GOOO=TRUE  INDICATES  THAT  THE  ENTRY 
TO  XOELAY  CORRESPONDS  TO  A VALID  POINT  OF  SOLUTION  TO  THE  DECS 
AND  IS  NOT  DERIVED  FROM  AN  INTERMEDIATE  CALCULATION  PRODUCED 
C QY  INTEG  NUMERICAL  INTEGR^TJON  ALGORITHMS. 

GO  TO  (ir,2I),  rSCO'RE 

^ CONTINUE 

TOLD=-l. 

XOLD=l.CEE 

D<=AK/4. 

1 = 1 

J=1 

IKY=1 

I3C0RE=? 

XOLAY=C. 

20  CONTINUE 

IF  (.NOT.  GOOD)  RETURN 
IF(KY-1>  90,90,95 

9J  IF  (ADS(X)-Dk;)  91,93,92 

91  XDLAY=0. 

RETURN  

92  TSTO“t(l)=T 
OLTX=ADS (X) 

KYr? 

TAU=AK/DLTX 
~ XOUT  ( 1)  = X 

TIMEOUT(l)=  T + TAU 
XDLAY=Q. 

XHOLD(l) =C. 

TOLO=t 

XOLO=X 


RETURN 

95 

IF  (T-TOLD)  50,50,100 

50 

IF  ( r-TSTORE( J) ) 55,55,100 

55 

J=J-1 

100 

GO  TO  5j 
1=1  + 1 

t 

J = J+  1 

4 

TSTORE { J ) =T 

OL  TX  = ADS ( X ) 
TOLO=  T 

% 

XOLD  = y 

i 

IF<DLTX-0<)  102,102,101 

i 

102 

XOUT ( I ) =X 
TIMEOUT! I)=T+TAU 

GO  TO  150 

1 

ICl 

TAU=  AK/DLTX 

XOUT ( I )=X 
TIMEOUT! I)=T+TAU 

JILlY^-1  ‘ ■ 

DO  120  JJJ=1,JILLY 

TFrTTME0UTm-TTMt0UT(r-JJJ»-l."6F-3)  120,120,13n 


99 


► - 


TrTJJT-i1"l^TTr  n>3  , ITTC 
TIMEOUT ( T +1-JJJ) = TIMEOUT(I) 
XOUT {Itl-JJJ) =X0UT (I ) 

I = I ♦ 1-J  J J 
GO  TO  IGO 
C J''U  IN'J_ 

T IMEOU r ( 1 ) =T IMEOUT ( I ) 
X1UT<1)=  XOJT(I) 

1 = 1 

XiJL  A ] . 

X H OL  0 ( J ) = r . 

GO  I 0 7 5 u 

IE  (T-T  tMf  OUT  ( 1 n lGT,173,lf;^ 
xoLA  r- : . 

XHOL  0( J) =C . 

GO  TO  7~j0 

iF(i-^t  iEi,io:,i9r 

IF(J-T)  173,1('5,17G 


MRITE  (9,531) 

FORMAT (IX, HHCHOOGE  SMALLER  STEP) 
STOP 

CO  13'.  IRO=l,5 

TTdOO)  = TGTORE  ( J-4  + I30) 

xx(ioo)=  xMOLD( j-4+ten) 


CONI  I NUl 

TT  ( 4 ) = T IMEOOT ( I) 

XX  (4)  = X0UT(T) 

GO  TO  27C 
30  21.  TJK=2,I 

IF ( T-TIMEOUT ( UK) ) 220,210,210 


JN  I L 

IFdJK-?)  230,230,240 
30  2S0  11=1,4 

TT(TI)=  TIMEOJT  (II) 
XX  ( d)  =XOUT(  II) 
CONTINUE 


G J I 
JO  29.'  11  = 1, *4 

TT  dI)  = TIME3UT  (I  J<-4+II) 
XXdI)=XOUT(T  J<-4«-II ) 
COMTIUUE 
ZArT-TT( 1) 


)=T-TT ( 2) 

/C=T-TT( 3) 
70=T-TT(4) 

Zt-l':  * 2D 
7r=7.\  * 70 
RA  = TT(1)  - TT(2) 


WC  = TT ( 1) -T  T ( 4) 

WO  = TT(2)  - TT(3) 

Wf  = TT(2)  - TT(4) 

Wr  = TT(3)  -TT(4) 

Ad)  = 2 IT  » 2E  / (WA  * HB  * WC) 


) = ZF  ♦ 2U  / ( MB  » HD  * WF) 
I = 7F  • 7C  Z t-HC  * WE  * HFI 


APPENDIX  B 


A SUBROUTINE  FOR  THE  ESTIMATION  OF  DESCRIBING  FUNCTIONS 


A.  THE  CLOSED  LOOP  SYSTEM 


It  is  assumed  that  the  describing  function  for  tlie  human  pilot 
dynamics  model  V^cjoj;  in  the  closed  loop  system  described  in  figure  1 
is  desired.  The  system  input  is  assumed  to  consist  of  a summation 
of  randomly-phased  sine  wave  components  - - each  with  an  amplitude 
scaled  to  match  a desired  input  spectra.  The  input  therefore  has 
power  content  only  at  n-discrete  frequencies  co^  . The  time  interval 
for  which  the  system  response  is  to  be  measured  and  used  for  the 
estimation  of  is  assumed  to  be  an  Integer  multiple  of  all 

the  input  sine  wave  component  periods;  in  particular,  it  is  assumed 
to  be  several  times  larger  than  the  period  of  the  lowest  frequency 
input  sine  wave.  In  practice,  this  is  not  always  practical;  it  is 
therefore  necessary  that  test  cases  be  run  to  determine  the  minimum 
acceptable  run  times  to  ensure  tolerable  measurement  accuracy. 


Provisions  are  contained  in  the  program  described  in  this  appendix 
for  the  estimation  of  the  total  open  loop  system  describing  function 
Yoi.  ‘ where  V'  csl  is  one  of  five  pre- 

scribed controlled  elements  corresponding  to 
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J<£_  _ _ 

S-2.  SCS-Zl 


according  to  the  value  of  the  integer  variable  OPTION 
respectively . 


1, 


O 

» 
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The  subroutine  YPILOT  described  for  describing  function  estimation, 
under  the  prescribed  restrictions,  may  be  used  for  the  estimation  of 
the  describing  function  for  any  dynamic  element  (e.g.  the  neuromuscular 
system)  provided  that  the  input  and  response  of  this  element  are  supplied 
via  Che  argument  list  to  YPILOT.  For  such  applications,  however,  it  is 
understood  that  the  open  loop  describing  function  calculation 
may  be  meaningless. 


B.  THE  ANALYTICAL  METHOD 


In  general  the  describing  function  for  the  human  pilot  dynamic 
response  (or  any  element  of  the  closed  loop  system)  is  given  as  the  ratio 
of  tlie  cross-spectral  densities 


< jt-o  ) 


I(L 


For  the  special  case  where  ilM  is  equal  to  the  sum  of  a number 
of  sine  wave  components  at  the  frequencies  , this  ratio  becomes 

S f j u>  k'i 

L'J*^k'>  ecj^ic)  e<j^x.') 

It  is  understood  that  tfiis  ratio  is  defined  only  at  the  input  fre- 
quencies . The  quantities  and 

are  the  Fourier  coefficients  of  the  time  signals  t(t)  , <?(t)  and 

For  any  signal  X(t)  , its  Fourier  transform  is,  in  the  subroutine 
YFILOT,  computed  in  the  following  way: 

/-jtOjt  t 

x(t)  e dt 

o 

-tf  tf 

- Z J x{t'j  COS  cO/^t  dt  - 2j X (O  s/V?  CL>f^  t dt 

e>  O 

— /?G  ^ (-J  J Ttri  Cj  )J 


/?e  [X(/'u>k)]  = 2 jx  (t)  cos  t c/t 
r^[X(y^«)J  ='^ Jx(t)  s/^ico^t  dt 


The  integrals  may  be  replaced  with  a suitable  numerical  approximation 
in  actual  computations;  e.g., 

- TP 


J x(t)dt  = 2! 


where  and  At  is  cliosen  to  be  sufficiently  small. 

The  ratio  of  any  two  Fourier  transforms  at  a particular  frequency 
may  be  expressed  as  an  amplitude  ratio  and  a phase  angle.  For  example 


X ( ;cOk.  ■) 

X t y<A* ) 

/ ( j‘cx>^  ) 

where 

X<jPo«) 

\x  (/co*)! 

|y(yco«;;| 

^ X ( ) 
1 

^ X ( yc*:'*:  ) 

t 

I C.  OKi-’lNITIONS  US'  VAK1AB1.es  USE!)  IN  SUBROUTINE  Yl’ll.OT 

[t  is  assumi.‘d  that  YPILOT  is  a submut  iae  in  a much  larger 
digital  computer  program  that  simulates  the  operation  of  the  entire 
pilot-vehicle  system.  This  program  is  .jssumcd  to  be  undi^r  the  ex- 
ecutive control  of  a M.A1N  program  which  initializes  the  program  i 

operation,  establishes  the  time  step,  calls  an  integration  subroutine,  j 

passes  required  information  to  YPII.OT,  and  performs  various  final 

computations.  Information  is  transferred  between  YPiLOT  and  MAIN  by  i 

either  an  argument  list  or  various  labeied  common  blocks.  The  following 

variablo  detinilions  an-  used;  1 

1.  F.  and  U are  .iiiy  two  continuous  time  signals  for  which  the  ratio  of  j 

Fourier  coetfieients  Dcjeo,^)/£  tjtoe  1 is  desired.  For  the  pilot-vehicle  i 

.system  shown  in  figure  1,  E = S (system  error)  and  D = <?  (the  pilot's  j 

control  respoase'l.  both  E <ind  1)  are  available  to  YPILOT  through  the  j 

argument  list.  j 

2.  VV(I)=<.Ok,  , the  input  sine  wave  component  frequencies.  W(I)  is  | 

' in  the  labeled  common  block  FRF.Q.  Tho  dimensions  of  W(I)  must  be  ! 

prescribed  in  both  M\1N  and  YPILOT.  | 

i.  /4(1)  are  the  amplitudes  of  the  input  sine  wave  components 
corresponding  to  Wc'.ri  . These  are  in  the  labeled  common  block  ABC. 

Not  used  in  YPILOT  for  computations. 

ii . C is  the  value  of  U actually  used  i:i  YPILOT  for  computations. 

Usually  C = 1).  This  variable  was  introduced  to  permit  the  scaling  of 

D within  YPILOT  without  affecting  corresponding  D values  in  MAIN.  , 

b.  DT  is  a constant  time  step  for  the  supply  of  input  signals  E and  0 
from  MAIN  to  YPILOT.  tt  is  the  time  step  for  the  output  of  the  integ- 
ration subroutine;  i.e.  it  is  the  time  step  for  which  system  response 
up-dates  are  available  in  MAIN.  it  is  available  in  the  argument  list. 

6.  TF  is  the  time  over  which  describing  function  computations  are  to 
be  made,  (leneraily,  TF  is  the  final  time  for  closed  loop  system 
simulation.  It  is  an  argument  list  variable. 

I 

7.  MSPFC  is  a control  variable  for  initializing  the  integrations  in 
YPILOT.  It  must  be  initinlly  set  to  I in  MAIN  and  re-set  to  1 for  each 

k new  simulation  run.  It  is  an  argument  li.st  variable. 

I 

j 8.  ZKC  is  the  controlled  element  gain  atid  ts  used  only  for  the  J 

calculation  of  tlie  open  loop  system  describing  function  ^ 

' 9.  ZLAMBUA  is  the  pole  A for  two  of  the  five  controlled  elements 

available  in  YPILOT  for  the  calculation  of  the  open  loop  describing 
■ function.  it  is  available  to  YPILOI  through  the  argument  list. 


10.  OPTION  is  m iiUe^ur  variable  in  the  labeled  . enunon  block  AHC 
prescribed  in  MAIN  and  used  for  the  definition  ol  >^fs)  . 


[ 
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11.  XCU)  :md/C(l)  are  the  .irtays  for  and  sin(cOBt)  , 

respectively.  These  are  computed  in  .MAIN  .and  are  avail.ibli-  in  the 
labeled  common  block  COMIUND.  Tliey  are  used  ior  the  Fourier  transform 

calculations.  j 

! 

12.  Z4  is  any  system  time  r<  spouse  it.  M.\1N  i or  which  the  mean-square 

or  root-mean-sepiare  v.ilue  is  to  be  computed  in  YPll.OT.  It  is  in  the  ] 

argument  list  I 


13. 

MStJBETA  = 

; i n 

labeled 

common 

block 

DENS  1 TV . 

14. 

RMS  BETA  = 0',, 

; in 

labeled 

common 

block 

DENSITY. 

15. 

MSQDEL  = 

; in 

labeled 

common 

b lock 

DENS  I lY . 

16 

MSQYE  = 

; in 

labeled 

common 

block 

DENSITY. 

17. 

YEAVG  = average 

value 

of  E (used  to 

determine  bias  in  E(t)  ) 

in  labeled  common  block  DENSITY. 

18.  AMPYP(l)  and  PHYP(I)  are  the  amplitude  and  phase  angle  arrays, 

respectively,  of  the  ratio  of  the  Fourier  coefficients  D < /£ 

Both  are  available  to  MAIN  in  the  labeled  common  block  DESFCN.  AMPYP(l) 
is  in  decibels  and  PHYP  is  in  degrees  following  the  completion  of  all 
cal cu la t ions. 

19.  A.MPYOL(I)  and  PliYOL(l)  are  the  amplitude  and  phase  angle  arrays, 
respectively,  of  the  (jpen  loop  system  describing  function. 

/\MPY0L(1)  = AMPYP(l)  X /\MPYC(I) 

PHYOL(l)  ^ PHYP(l)  + PHYCfl) 

The  units  are  decibels  and  degrees  following  the  completion  of  all 
calculations. 

20.  AMPYC(I)  and  PIIYO(I)  are  the  amplitude  and  phase  arrays,  respectively, 

of  the  controlled  element  transfer  function  at  the  frequencies 

W(I). 

D.  I.1STING  FOR  SUBROUTINE  YPILOT 

A listing  for  the  subroutine  is  shown  on  the  following  pages. 

The  coding  is  in  Fortran  IV  and  is  compatible  with  the  CDC  6b00  digital 
computer  systems. 
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SUa^'OUTINiI  YPILOT  ( E , 0 , 0 T , T F , MS  P EC , , ZKC  , ZL  AM  BO  A ) 

nr  ME  NS  ION  WEC(  !.'• ) , < IMC<  1-j  I , PEE  < 1 j)  , XIME  ( 10  t 
niMENSION  AMPYC(  1 •)  ,PHYC(  i:  ) 

COMMON  ZCOMMANO/  XC ( I 0 1 , YC ( 1C ) 

COMMON  /ABC/  OPII)N,A(10I 

COMMON  ZEMIO/  W<10» ---  

COMMON  ZCENSITY/  1 S 00 IL , ^KS PE TA , MS  0 Yc , Y E A VG 

COMMON  ZCESFCN/  A IPYPUJl  , PHYP  ( 1C  ) , AMPYOL  1 1 C ) ,PHYOL  (10) 

INTEGER  OPTION 

REAL  ISaOEL.MSOBETAtMSQYE 

C=ZKC*0 

CO-TO  (5,2i.,50)t  M.P^C  - 

5 DO  10  1=1,10 

REC(I) =0. 

XIMC (I ) =0. 

REE(I)=C. 

XIME(I)=0. 

1-G-GONTI-NUE 

MSPEC=2 

CSQ=0.  

ye5;q=  j. 

YE=0.  - 

OETASO=0 . 

20  DO  SI  1=1,10 
- - REC ( I) =REC( I) +G*XC( I) 

XIMC(  I ) =XIMC(I ) fC»YC ( I ) 

REE ( I > =R£E ( I) +E"XC( I)  

XIME(T)=XIME(I) +E*YCtI) 

30  -CONTINUE-  

CSO=CSQeC*C 

YE=YEtE 

YE3Q=YES0e':*5 

BE TASQ=3ETA3Q+Z4» ZA 
RETURN 

SO  -00  60-  1 = 1,10—  - — - 

REC  (I)  =OT2»R'^C  ( I ) 

XIMC(I) =nT2*XIMC( I) 

REE  t I ) =OT2»REE ( I ) 

XIME ( I ) =OT ?»XI"E ( I) 

AMPYP  t I) =SQRT (REC ( I)**2  + YTMC(I»**2) /SORT (REE(I)**2eXIM^ 

PHYP ( I ) = ( AT AN2 ( XIMc ( I ) ,Rc  E ( I ) )- AI AN2 ( XIMC ( I ) ,REC( I ) » ) *S 

GO  TO  ( ’CO , 220 , 240, 26 0 , 2^0)  , OPT  ION 
?C 0 AMPYC(I)=ZRC 
PHYC  ( I ) =■’  . 

GO  TO  300 

220  AMPYC( I) =ZKC/H(I) 

GO  TO  3)0 

240  AMPYO( I ) =ZKCZ (H ( I) *M ( I ) ) 

PHYC(I)=-1H0. 

CO  TO  one 


( I)  »*2) 
7.3 


I 


2oG  ()xi  = sTr-;r  { ZLA'-niOA’ZLA'-iinn  + w { I ) »w  ( I ) ) 

AHPYG  ( I ) -ZKO/vGXt 

PM/r ( n = ( a TAM? ( W ( I)  , 7LAMPGA ) ) »5  7 . 3 
r.O  TO  3G: 

2d  j J<l  = Sa<T  (ZLA  '3'JA»ZLA  lOOA  M ( I ) »',!  ( I ) ) 
AMPYC(I)=ZKC/(H(I)*OXl) 

PilYG  ( I ) = 07  . i*  AT  ati?  { M(  I)  .^LAMPDA  I - . 

30  0 AHPYOL  ( I I r A'-^^YPC  I)  » AMPYC  ( I) 

PHYOL ( I) =PHY?(T ) +P3 YC  (T) 
AMPYOL(I)=20.*ALOG13( AHPYOL ( I ) ) 

AMPY  'M  I ) = 2‘.:  .♦ALCGIO  ( AMPYP(  I ) > 

60  CONTIMU'^ 

MS0n£L  = C'"0*nT/TF 

MSOj9ETA  = Or  TA3Q*DT/TF  

RMSBETA=GQPT(MSQQ£TA) 

MSQYE=YESO*QT/TF  

YEAVG  = YE*‘DT/TF 

RETURN 
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TABLE  7 - PERFORMANCE  COMPARISONS:  MEASURLO  VS  KI.K I NMAN-DJ  LLOW 
MODEL  PREDICTIONS  ( M I LEER- V I N.IE  |2'Ij) 


i I I er  - 7 i nje  Lx;:er  I men  ! 


F 1 1,-  i nmdi  -U  i I I ‘.-ij  i t 1 ; n 

cl  r^i  o-e  a-. 


<0. 

1.40 

. 7 ^0 

. 575  . T71 

l.ST-i 

.732 

1.84 

1.10 

.950  .6,82 

2.1L 

1.343 

2.6 

1.80 

1.24  .171 

2.754 

l.=>62 

3.46 

2.85 

"•16  I..453 

1.77 

0,09 

?.?0 

".56 

3.235  1,  2? 

4.52 

4.10 

1.0 

1.63 

1«26  .67.3 

1 .466 

1.400 

2.25 

1.7: 

1.37  ..-a 

2.22 

1.7U 

3.25 

1 .72 

1.35  1,  ,g? 

3.26 

2.10 

3.43 

*'  • 

1.34 

3., CP 

2.53 

2 .43 

1.75 

1.21  .872 

^ • 36 

1.784 

1.40 

1.'? 

.''7  .532 

i.ro 

1.056 

^.30 

^ , 7f 

1.805  1.440 

4.08 

2.92 

'i  0.2 

2.00 

1 . |fl  I.2f;4 

4.30 

2.47 

5.':2 

:-.65 

2.455  I. ->61 

5.70 

3.77 

3.22 

1.64 

1.04  .974 

3.30 

1.917 

4.31 

3.31 

2.415  1.670 

4.73 

3.48 

3.01 

1.56 

1.  75  .35'^ 

2.92 

1.700 

4. ’’2 

3.30 

2.37  1.566 

i-p  #41 

3.31 

1.36 

.93 

.840  .540 

1.655 

1.98V 

2.38 

1.86 

1.42  l.'iu 

2.  ->7 

2. '"9 

2.05 

1.54 

1.17  .376 

2.47 

1.813 

1.86 

i.52 

1.40  1.055 

2.87 

2.07 

4.42 

*6^ 

1.'8  1.S7 

6.2  s 

3.65 

3.18 

2.17 

1.51  1.25 

3.77 

2.45 

*.04 

2.45 

1.77  1.44 

3.75 

2.85 
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TABLE  8 - CONVERSION  OF  MILLER-VINJE  POK  TO  THE  COOPER-ILXRPER  SCALE 
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Conversion  e’:juatlon8  • Coopt  (C) 

0 i G i 3.5 
3.5<C  < 5.5 
5.5<C  < 7.6 


Coocer-Harper  (C-H)  j 

I 

C • 

3.5  +1.5  (G-3.5  ) j 

6.5  +■  1.67  (C-5.5)  I 
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Xe- 

-< 

< 

Xp 

PH  1 

Y 

I2.& 

.949 

5.  SB 

.969 

3.30 

— 

.866 

8.55 

.937 

.285 

S.2 

,953 

4.oe 

376 

3.ZZ 

■ 908 

5.64 

■ 9S& 

.4/5 

3.47 

.947 

S.oo 

.977 

Z.70 

.929 

6.68 

.969 

.37/ 

4 

£■.55 

.937 

3,86 

.978 

z.oe 

.95'0 

4.87 

.979 

.46-7 

S 

S3S 

.930 

3.54 

.979 

/.as 

.96/ 

4.22 

.984 

.sn 

6 

//.8 

.es3 

5.87 

.972 

309 

.382 

7.76 

,98/ 

.300 

7 

9.0Z 

.93/ 

4.6/ 

.976 

2.47 

.954 

6,/9 

.977 

.360 

9 

6.57 

.954 

3.58 

.978 

1.94 

.914 

4.60 

.964 

.45/ 

to 

6.24 

.959 

3.33 

.979 

2.50 

.9/6 

4.56 

.96/ 

,369 

!Z 

S.53 

.937 

4.47 

,976 

/■&& 

.940 
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.974 

.493 

/3 

8.44 
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1-  - - 
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.973 
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.929 
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.965 
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IS 

6.7/ 

.95/ 
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6.0& 
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.977 

Z.ZB 
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3./0 

.953 
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20 

5.03 

.945 
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.979 

2.19 

.916 

1.77 

.973 

.4/8 

Z! 
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3.54 

.976 

2.4Z 
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2.53 

.955 
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2Z 

5.04 

.939 

J./6 
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a. OS 

.933 

4.08 
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/.57 
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6,16 
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.977  1 2./6 
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3! 

a.oo 
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S.6S 
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.9ao 

Z.lZ 
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TABLE  13  - AIRCRAFT  STABILITY  DERIVATIVE  SET;  CASE 


100  .09  16100  ' » -.001  -J?69  26.39  -2P.22 


5.44 


TABLE  IS  - KLKIN^UN-IMI.LUW  MODEL  i’AILAMETEKS  (,  EKKDICTKI)  I'OK; 
CASE  l,Cr^^g=  10  l7-s 


Conf 

Ki 



1 

J 

!>0R^ 

n/ oc 

CAP 

1 

1 

3.43 

.858 

1.82 

5.  35 

7.1 

1 

. 16 

2. 

0 

. 3 

5 

2 

3.25 

.855 

1.45 

4.06 

6.  7 

5 

3 

3.  38 

.847 

1.33 

3.80 

6. 6 

10 

4 

3.25 

. 829 

1.45 

3.90 

6.  7 

50 

5 

3.  37 

.807 

1.74 

4.73 

6.9 

100 

6 

1.80 

.851 

1.  33 

2.03 

5.6 

1 

, 2 

8 

.5 

7 

2.54 

.842 

-91 

1.95 

5.5 

5 

8 

6. 17 

.901 

1.55 

8.61 

7.9 

10 

9 

.849 

.815 

1.22 

.84 

4.2 

50 

10 

. 353 

. 783 

1.55 

.43 

3.5 

100 

11 

1.  38 

.836 

.83 

.96 

4. 4 

1 

3. 

6 

12 

.660 

. 794 

1.31 

.68 

4.0 

5 

13 

.168 

.743 

1.55 

.19 

3.1 

10 

14 

.045 

.609 

2.61 

.07 

2.6 

50 

15 

no 

convergence 

100 

16 

3.46 

.836 

.82 

3.  38 

6 . 4 

1 

0 

o 

. 35 

17 

3.42 

.800 

1.95 

5.  34 

7.1 

5 

18 

3.66 

. 766 

2.49 

6.97 

7.6 

10 

19 

3.50 

.627 

3.78 

8.28 

7.° 

50 

20 

3.68 

.559 

4.47 

9.21 

8. 1 

100 

21 

.81 

. 818 

1.50 

.99 

4.  5 

1 

10. 

2 

.0 

22 

. 19 

. 742 

2.50 

. 35 

3.4 

5 

23 

.08 

.678 

2.96 

. 15 

3.0 

10 

24 

no 

convergence 

50 

25 

.01 

.451 

5.58 

.02 

1.9 

100 

1.  fromC/i^&  figure  24 


124 


TABLE  16  - KLE  1N^UN-I)1I.L0W  MODEL  1>AR;\METKKS  6 EREUICTEI)  ROR ; 

CASE  2,  Cr,^  = 10  f /s 

3 


1 - from  ^ & figure  24 


1 

I 

TABLE  20  - KLEINMAN-DILLOW  MODEL  PARAMETERS  & PREDICTED  POR; 

CASE  3,0'^=  16  f/s 

9 

Kr-  0-35 

Conf  Ik*  I Kf^  tr^  PnR*  n/oi  co^  ^ 

36  38.3  .835  1.34  42.9  10.  2.  2.  .05 

37  4.02  .832  1.2.4  4.82  7.  .10 

38  3.56  .829  1.42  4.19  6.7  .20 

39  3.58  .828  1.35  4.00  6.7  .50 

40  3.40  . 836  2. ■'5  . 5.84  7.3  i 2.0 

41  176  .790  3.62  503.  10.  50.  5.  .05 


TABLE  22  - PREDICTED  VARIATION  OF  POR  WITH  AT  CONSTANT 


31.623  1.9 


DISPLAY  PILOT 

r 1 r 1 CONTROLLED 


y:«)=  random  command  input,  low  amplitude,  low  bandwidth. 

^*tt)  = displayed  system  error. 

S(t)=  pilot's  control  output. 
y(t)=  controlled  'lement  response. 

Y^{8)=  controlled  element  dynamics,  transfer  function 
representat ion . 

Yp(jfa>j=  portion  of  pilot's  dynamic  response  that  is  linearly 
correlated  with  system  input,  describing  function 
representat ion . 

n(t)=  portion  of  pilot's  response  that  is  not  linearly 
correlated  with  system  input;  the  remnant. 

^(ja>)=  Yp(  j «0  ) e(  j )+n(  j ) 


« 

■V 

t 

r: 


Figure  I The  Servo  Model  for  Pilot  Dynamics  (The  Precision 

Pilot  Model ) 
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Figure  2 The  Optimal  Control  (Kleinman)  Model  for  Pilot  Dynamics 


DffCKCCS 


i'jare  9 Nonlinear  Model  for  Pi lof-Veh ic I e 5vs*om  Dynamics 


Phase 


Phase  Angle,  Degrees  Amplitude  Ratio,  DB 


Pilot  Model 


figure  17 Measured  Controlled  Element  Dynamics,  ( s)  = I I .9/( s-2) 


' 1 ri  i ? _ 

r__ji  L.r_  i 

r- 

1 J 1 

llJ 

, ■ . 1 1 J 

-Ml 

•t-  _ 

60  rad  i an/second  

j ( 

i 1 

1 

1 

1 

.1 

Wiase 


ta>  rad  ian/second 


Pilot  Model  (with  mode  switching) 


O same  as  ♦except  TF=240 
0 same  as^ except  A T=. 00625 
A same  as  a except  TF=80 


Measured  Controlled  Element  Dynamics,  Y (s)=ll.9/ 


radian/second 


Pilot  Model  (with  mode  switching) 


Figure  19 Measured  Controlled  Element  Dynamics,  Y ( s ) = I I . 9/s ( s-2) 


-270  — 


D& 


Ai-iPLiToioe  i?AT>o'^  06  Phase  ~ Outnees 


Figure  21 Comparison  of  Measured  and  Experimental  Yp(j<^) 
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W-  <V.- 


Figure  23 Equivalent  Kl e i nman-D i I I ow  Model  (Converged)  for  the  Arnold  Experiment 


With  the  Proposed  Rating  Metric 


Simulation  Pilot  Ratings  ( Arnold  C 1 83  ) 


ion  Rating 
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Figure  31 Variation  of  Pilot  Opinion  Rating  WithCJ*. 

Multiple  Loop  Tracking  ( Teper  Data  C I 2J 


for 

) 
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lO 


Figure  34 


— - Comparison  of  Predicted  POP  With  MIL-F-8785E; 

Case  2 Parameter  );  Olj,  - 10  f 


1 6b 


Paper  Pilot  Rating 


(from  Dillow  & Picha,  reference  25,  page  56) 


Figure  35  — Comparison  of  Paper  Pilot  Rating  Prediction  and 
Actual  Pilot  Rating  for  Arnold's  Experiment. 


Paper  Pilot  Rating  Prediction 


(from  Dillow  & Picha,  reference  25,  page  88) 


Figure  38  — Comparison  of  Paper  Pilot  Rating  Prediction  and 
Actual  Pilot  Rating  for  McDonnell's  F.xperiment. 
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